dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 6/5/2022 9:07:46 PM #6146

Closed performanceautofiler[bot] closed 1 year ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).ImmutableDictionary(Size%3a%20512).html>) 219.97 μs 162.78 μs 0.74 0.05 False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>) 75.54 μs 57.71 μs 0.76 0.06 False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).ConcurrentDictionary(Size%3a%20512).html>) 56.24 μs 43.11 μs 0.77 0.04 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.TryGetValueFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>) 73.40 μs 54.57 μs 0.74 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryGetValueFalse<Int32, Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 162.7758273625429 < 211.55176394540158. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.817615904315314 (T) = (0 -163613.34340511297) / Math.Sqrt((564196122.2549665 / (299)) + (4370737.4796171775 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07761353143163552 = (177380.4679280011 - 163613.34340511297) / 177380.4679280011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.70808733678683 < 71.98769916653474. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.285862331503267 (T) = (0 -57471.56446215959) / Math.Sqrt((59825874.5577625 / (299)) + (1031644.5614284022 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07725661301534097 = (62283.36639720083 - 57471.56446215959) / 62283.36639720083 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.11184245768159 < 53.76048840461273. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.033903558323384 (T) = (0 -44130.23692315) / Math.Sqrt((24132485.721365266 / (299)) + (682035.9743797777 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07673293091072048 = (47797.91070278347 - 44130.23692315) / 47797.91070278347 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.TryGetValueFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.57467283653847 < 69.54923014472088. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.051401598265238 (T) = (0 -53496.48755963134) / Math.Sqrt((47291436.3771744 / (299)) + (914835.2455956519 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10517003181766392 = (59783.96953814422 - 53496.48755963134) / 59783.96953814422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Perf_Utf8Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetString(Input%3a%20EnglishMostlyAscii).html>) 2.39 ms 1.40 ms 0.59 0.05 False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetBytes(Input%3a%20Chinese).html>) 4.16 ms 2.44 ms 0.59 0.08 False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetString(Input%3a%20EnglishAllAscii).html>) 484.26 μs 379.37 μs 0.78 0.12 False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetString(Input%3a%20Greek).html>) 3.72 ms 2.32 ms 0.62 0.04 False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetBytes(Input%3a%20EnglishAllAscii).html>) 2.16 ms 1.27 ms 0.59 0.11 False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetByteCount(Input%3a%20EnglishAllAscii).html>) 667.92 μs 397.28 μs 0.59 0.06 False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetBytes(Input%3a%20Cyrillic).html>) 2.57 ms 1.66 ms 0.64 0.02 False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetString(Input%3a%20Chinese).html>) 4.56 ms 2.55 ms 0.56 0.07 False
[GetByteCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetByteCount(Input%3a%20Chinese).html>) 1.42 ms 889.11 μs 0.63 0.10 False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetBytes(Input%3a%20Greek).html>) 3.51 ms 2.30 ms 0.66 0.02 False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetString(Input%3a%20Cyrillic).html>) 2.63 ms 1.61 ms 0.61 0.02 False
[GetBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Perf_Utf8Encoding.GetBytes(Input%3a%20EnglishMostlyAscii).html>) 3.10 ms 1.99 ms 0.64 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Perf_Utf8Encoding.GetString(Input: EnglishMostlyAscii) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.404585738199301 < 2.283362898779762. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.933793751377644 (T) = (0 -1419421.5454376903) / Math.Sqrt((185333751313.08423 / (299)) + (878191985.8129466 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1499702115434613 = (1669849.180244657 - 1419421.5454376903) / 1669849.180244657 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: Chinese) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4367423380102036 < 3.947436075771949. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.793525421834108 (T) = (0 -2423971.9037737316) / Math.Sqrt((547842892580.51385 / (299)) + (2001550801.8185573 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14866231470615823 = (2847250.7979452247 - 2423971.9037737316) / 2847250.7979452247 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetString(Input: EnglishAllAscii) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 379.3704884581882 < 460.5502172646234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.12787553314949 (T) = (0 -357572.0292966954) / Math.Sqrt((2934630358.268323 / (299)) + (111057911.66824041 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08061360329972676 = (388924.64645990025 - 357572.0292966954) / 388924.64645990025 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetString(Input: Greek) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.317153517261905 < 3.541297750375. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.359386021044811 (T) = (0 -2263992.4748023665) / Math.Sqrt((387334261548.9191 / (299)) + (1479213880.553724 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13066260486503095 = (2604273.6542477505 - 2263992.4748023665) / 2604273.6542477505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishAllAscii) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2741421302083333 < 2.0512185302487547. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.81786301062744 (T) = (0 -1284648.7295972826) / Math.Sqrt((145930861173.44708 / (299)) + (3542277824.279996 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13892311227640802 = (1491909.4309841217 - 1284648.7295972826) / 1491909.4309841217 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetByteCount(Input: EnglishAllAscii) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 397.28456655982905 < 634.5374705648292. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.311871290550476 (T) = (0 -398082.5568522767) / Math.Sqrt((12524428133.203487 / (299)) + (15528218.560780048 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14398629386751952 = (465042.26976789517 - 398082.5568522767) / 465042.26976789517 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: Cyrillic) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6553154354166666 < 2.4429228143638393. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.138745057853469 (T) = (0 -1627876.553226305) / Math.Sqrt((181111408638.44745 / (299)) + (482919365.1200829 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0980382426653703 = (1804817.7098293086 - 1627876.553226305) / 1804817.7098293086 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetString(Input: Chinese) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5538727031250006 < 4.274991987971754. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.005990770538018 (T) = (0 -2503567.485283901) / Math.Sqrt((677700121706.8083 / (299)) + (1143245494.366072 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17372423132029455 = (3029941.794474158 - 2503567.485283901) / 3029941.794474158 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetByteCount(Input: Chinese) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 889.1100752314815 < 1.348328771369724. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.342853048661757 (T) = (0 -900169.1370444251) / Math.Sqrt((60736447705.411835 / (299)) + (242166982.13967732 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07875658323689706 = (977124.0919227138 - 900169.1370444251) / 977124.0919227138 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: Greek) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3038725226190473 < 3.3408529064217034. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.134204800018622 (T) = (0 -2242771.7581322542) / Math.Sqrt((327217102652.79626 / (299)) + (1019894215.6887734 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09592490945188722 = (2480736.1485565663 - 2242771.7581322542) / 2480736.1485565663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetString(Input: Cyrillic) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6061456598214285 < 2.5213281567795134. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.986037878231661 (T) = (0 -1573882.8566327144) / Math.Sqrt((195168186304.2662 / (299)) + (394427256.6737967 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14013609595972423 = (1830386.0055497738 - 1573882.8566327144) / 1830386.0055497738 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishMostlyAscii) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.9904431780133929 < 2.939001143277816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.538957216841174 (T) = (0 -2006189.7098943258) / Math.Sqrt((222811464640.93967 / (299)) + (209382847.2355463 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10432820179956091 = (2239871.472926926 - 2006189.7098943258) / 2239871.472926926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Numerics.Tests.Perf_Plane

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DotCoordinateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.DotCoordinateBenchmark.html>) 53.05 ns 37.77 ns 0.71 0.23 False
[CreateFromScalarXYZDBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.CreateFromScalarXYZDBenchmark.html>) 34.31 ns 28.54 ns 0.83 0.28 False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.DotBenchmark.html>) 59.15 ns 42.54 ns 0.72 0.18 False
[NormalizeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.NormalizeBenchmark.html>) 55.14 ns 35.92 ns 0.65 0.18 False
[DotNormalBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.DotNormalBenchmark.html>) 50.05 ns 35.54 ns 0.71 0.21 False
[TransformByMatrix4x4Benchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.TransformByMatrix4x4Benchmark.html>) 541.19 ns 335.56 ns 0.62 0.09 False
[TransformByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark.html>) 161.19 ns 104.80 ns 0.65 0.19 False
[CreateFromVerticesBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark.html>) 207.38 ns 142.13 ns 0.69 0.15 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Plane*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Plane.DotCoordinateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.76972248202089 < 51.023298430425996. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.66392080801815 (T) = (0 -38.25680359352943) / Math.Sqrt((34.865206059375005 / (299)) + (2.1561800259193777 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1233182808362017 = (43.63819018608003 - 38.25680359352943) / 43.63819018608003 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.CreateFromScalarXYZDBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 28.541975307011562 < 32.713266496344716. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.960132142984936 (T) = (0 -28.956702065894547) / Math.Sqrt((5.630745628905566 / (299)) + (1.3385597339007065 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06638565470860601 = (31.01569958938105 - 28.956702065894547) / 31.01569958938105 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.53786702434435 < 57.57077348799947. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.438788121665896 (T) = (0 -42.708929277988155) / Math.Sqrt((50.66610372488042 / (299)) + (3.4370593777864156 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10508859888820694 = (47.72419842336205 - 42.708929277988155) / 47.72419842336205 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.NormalizeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.92060132701004 < 52.185986623366816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.19263969985846 (T) = (0 -35.67598754692101) / Math.Sqrt((36.88289101100118 / (299)) + (3.7797093779708106 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.21368514774427239 = (45.371122578412596 - 35.67598754692101) / 45.371122578412596 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.DotNormalBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.5418439896278 < 47.44360515158755. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.451661194353658 (T) = (0 -36.69458729312721) / Math.Sqrt((29.739438278870175 / (299)) + (5.196517739778421 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10147907560899008 = (40.8388789810295 - 36.69458729312721) / 40.8388789810295 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.TransformByMatrix4x4Benchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 335.5627148057082 < 515.7829498477261. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.096196459032097 (T) = (0 -341.47559816338924) / Math.Sqrt((6273.761359008881 / (299)) + (76.60487276563842 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1633661548209136 = (408.15417656250133 - 341.47559816338924) / 408.15417656250133 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 104.80190036504868 < 155.08058297565162. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.686678579149651 (T) = (0 -106.97477757761577) / Math.Sqrt((560.7850462963978 / (299)) + (11.361529458189658 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12598831721727796 = (122.3951346245443 - 106.97477757761577) / 122.3951346245443 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 142.12639788170048 < 183.88713094274672. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.541206750211147 (T) = (0 -142.6036939616253) / Math.Sqrt((490.14218910899956 / (299)) + (18.365414476394694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10980469484341075 = (160.19371607058824 - 142.6036939616253) / 160.19371607058824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total%3a%20400000%2c%20unique%3a%201%2c%20cacheSize%3a%2015).html>) 790.12 ms 602.44 ms 0.76 0.04 False
[IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total%3a%20400000%2c%20unique%3a%207%2c%20cacheSize%3a%2015).html>) 1.04 secs 815.33 ms 0.78 0.03 False
[IsMatch_Multithreading - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch_Multithreading(total%3a%20400000%2c%20unique%3a%201%2c%20cacheSize%3a%2015).html>) 255.35 ms 200.85 ms 0.79 0.02 False
[IsMatch_Multithreading - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch_Multithreading(total%3a%20400000%2c%20unique%3a%207%2c%20cacheSize%3a%2015).html>) 339.25 ms 285.37 ms 0.84 0.02 False
[IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total%3a%2040000%2c%20unique%3a%201600%2c%20cacheSize%3a%203200).html>) 183.69 ms 158.35 ms 0.86 0.06 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 1, cacheSize: 15) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 602.4441383999999 < 763.9261030633332. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.31038555111905 (T) = (0 -616372361.1958462) / Math.Sqrt((4394776359455280 / (299)) + (91473652875007.03 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10192737298840938 = (686327967.9805799 - 616372361.1958462) / 686327967.9805799 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 7, cacheSize: 15) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 815.3347378 < 0.98301835637. IsChangePoint: Marked as a change because one of 4/20/2022 8:23:28 AM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.191619098534161 (T) = (0 -828736131.9045069) / Math.Sqrt((5360812714501039 / (299)) + (193672591085947.5 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07814997945292457 = (898992366.9065932 - 828736131.9045069) / 898992366.9065932 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch_Multithreading(total: 400000, unique: 1, cacheSize: 15) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 200.84836607692307 < 235.64794786166667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.66494914429489 (T) = (0 -204491810.50650188) / Math.Sqrt((235467469774520.28 / (299)) + (11565752719178.441 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08341203237786753 = (223101129.11148813 - 204491810.50650188) / 223101129.11148813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch_Multithreading(total: 400000, unique: 7, cacheSize: 15) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 285.3669124 < 321.89127783845237. IsChangePoint: Marked as a change because one of 4/20/2022 9:36:38 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.441527023924388 (T) = (0 -285302858.48623097) / Math.Sqrt((454489244334292.4 / (299)) + (25028916279982.277 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05763499107000203 = (302751965.3028885 - 285302858.48623097) / 302751965.3028885 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 40000, unique: 1600, cacheSize: 3200) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 158.34907617857144 < 173.3465080433333. IsChangePoint: Marked as a change because one of 4/20/2022 9:36:38 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.065979117173187 (T) = (0 -152770292.0048371) / Math.Sqrt((163981893155202.7 / (299)) + (10585175528400.309 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05355270771988646 = (161414474.16135955 - 152770292.0048371) / 161414474.16135955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in StoreBlock.LocalAddress

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllOnes8.html>) 9.85 ns 5.91 ns 0.60 0.26 False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.CopyBlock128.html>) 13.31 ns 7.67 ns 0.58 0.09 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.CopyBlock32.html>) 10.03 ns 5.73 ns 0.57 0.11 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.CopyBlock64.html>) 10.09 ns 5.78 ns 0.57 0.15 False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllZeros16.html>) 9.70 ns 5.76 ns 0.59 0.26 False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllZeros8.html>) 9.75 ns 5.97 ns 0.61 0.09 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllZeros128.html>) 10.20 ns 6.04 ns 0.59 0.32 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllZeros32.html>) 9.74 ns 5.55 ns 0.57 0.16 False
[InitBlockAllOnes128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllOnes128.html>) 10.44 ns 8.59 ns 0.82 0.34 False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllOnes16.html>) 9.80 ns 5.51 ns 0.56 0.18 False
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.CopyBlock8.html>) 10.05 ns 7.03 ns 0.70 0.14 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllOnes32.html>) 9.83 ns 5.68 ns 0.58 0.18 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllZeros64.html>) 9.72 ns 5.89 ns 0.61 0.16 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.InitBlockAllOnes64.html>) 9.83 ns 5.49 ns 0.56 0.19 False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.LocalAddress.CopyBlock16.html>) 10.09 ns 5.77 ns 0.57 0.15 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'StoreBlock.LocalAddress*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.LocalAddress.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.906272416225077 < 9.360740823883793. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.627782774657939 (T) = (0 -6.2410049792701745) / Math.Sqrt((2.408289471394479 / (299)) + (0.2254166138774587 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11842238210474464 = (7.079359607802225 - 6.2410049792701745) / 7.079359607802225 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.673604636614747 < 12.63642497968628. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.672438335684694 (T) = (0 -8.008994080289032) / Math.Sqrt((5.30683339569223 / (299)) + (1.204797103768891 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14169067967659066 = (9.33112794029926 - 8.008994080289032) / 9.33112794029926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.731412642531181 < 9.535024288802816. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.522315102520702 (T) = (0 -6.088339862291985) / Math.Sqrt((2.707358038741834 / (299)) + (0.22061674425758082 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15166373169813085 = (7.176800155531639 - 6.088339862291985) / 7.176800155531639 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.784510637509266 < 9.58166093362844. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.067413682343323 (T) = (0 -6.184678058315916) / Math.Sqrt((2.7050583095957026 / (299)) + (0.6460563910547433 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14146952756674178 = (7.2037956215895536 - 6.184678058315916) / 7.2037956215895536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.757903429867585 < 9.221746677269243. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.978688077068376 (T) = (0 -6.248353296195098) / Math.Sqrt((2.655472916198182 / (299)) + (0.22674131577717907 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11268992924649589 = (7.0419050816012865 - 6.248353296195098) / 7.0419050816012865 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.9746748185897065 < 9.261229586651607. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.772783752467154 (T) = (0 -6.184385693231351) / Math.Sqrt((2.525124553365067 / (299)) + (0.03777550859272762 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10716297346174276 = (6.9266680361697075 - 6.184385693231351) / 6.9266680361697075 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.03769353475108 < 9.674384723506245. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.670549979190711 (T) = (0 -6.478880992552865) / Math.Sqrt((2.753462660174651 / (299)) + (0.35936521994199844 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11479181023031192 = (7.319047730724824 - 6.478880992552865) / 7.319047730724824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.546017286992254 < 9.235975596591834. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.249575120432619 (T) = (0 -6.011899990298138) / Math.Sqrt((2.8780077250109977 / (299)) + (0.11025015624179368 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12873339794275115 = (6.900184141229266 - 6.011899990298138) / 6.900184141229266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.585128290085132 < 9.662199259987428. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.12470674598583 (T) = (0 -6.370537809244898) / Math.Sqrt((2.6622886745619905 / (299)) + (0.2582856894843214 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1435206927213988 = (7.438052215746817 - 6.370537809244898) / 7.438052215746817 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.510932016476818 < 9.313792384367824. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.703891515410321 (T) = (0 -6.191034298998635) / Math.Sqrt((2.5496179680219653 / (299)) + (0.1491849763742618 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11654814139373308 = (7.007777773839999 - 6.191034298998635) / 7.007777773839999 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.026531005941483 < 9.554238196000375. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.521365007382235 (T) = (0 -6.209726961686224) / Math.Sqrt((2.536661970321175 / (299)) + (0.1568323262797706 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14033688187259774 = (7.223442335426493 - 6.209726961686224) / 7.223442335426493 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.683510783898824 < 9.320749646980863. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.784402517936774 (T) = (0 -5.862973323776309) / Math.Sqrt((2.572978311909479 / (299)) + (0.07579015711831537 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15525344891159065 = (6.940511702855953 - 5.862973323776309) / 6.940511702855953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.8880494094308045 < 9.24114688794596. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.0796661860751815 (T) = (0 -6.066044404009699) / Math.Sqrt((2.6081879028420025 / (299)) + (0.2345041806241708 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11708457880636913 = (6.8704705551624565 - 6.066044404009699) / 6.8704705551624565 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.492619491342765 < 9.34844583801853. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.82454402045786 (T) = (0 -5.99416447504614) / Math.Sqrt((2.620347093306061 / (299)) + (0.20080397584406148 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1405994775487818 = (6.974820608613703 - 5.99416447504614) / 6.974820608613703 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.768754377214247 < 9.521034495699304. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.368647186288511 (T) = (0 -6.170584987810156) / Math.Sqrt((3.0464156882897586 / (299)) + (0.15612679973228136 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14769727098467 = (7.239898193144432 - 6.170584987810156) / 7.239898193144432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetPinnableReference - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).GetPinnableReference(Size%3a%20512).html>) 22.51 ns 18.27 ns 0.81 0.11 False
[LastIndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).LastIndexOfValue(Size%3a%20512).html>) 1.59 μs 863.38 ns 0.54 0.06 False
[Fill - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).Fill(Size%3a%20512).html>) 4.05 μs 2.02 μs 0.50 0.15 False
[EndsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).EndsWith(Size%3a%20512).html>) 693.95 ns 442.12 ns 0.64 0.09 False
[IndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).IndexOfValue(Size%3a%20512).html>) 1.76 μs 999.57 ns 0.57 0.06 False
[SequenceEqual - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).SequenceEqual(Size%3a%20512).html>) 1.26 μs 765.08 ns 0.61 0.11 False
[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).Clear(Size%3a%20512).html>) 91.18 ns 79.55 ns 0.87 0.22 False
[StartsWith - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).StartsWith(Size%3a%20512).html>) 690.76 ns 438.41 ns 0.63 0.06 False
[SequenceCompareTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).SequenceCompareTo(Size%3a%20512).html>) 1.84 μs 1.22 μs 0.66 0.08 False
[LastIndexOfAnyValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).LastIndexOfAnyValues(Size%3a%20512).html>) 7.88 μs 4.26 μs 0.54 0.11 False
[BinarySearch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).BinarySearch(Size%3a%20512).html>) 361.75 ns 233.07 ns 0.64 0.10 False
[IndexOfAnyThreeValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).IndexOfAnyThreeValues(Size%3a%20512).html>) 3.26 μs 2.62 μs 0.80 0.17 False
[IndexOfAnyFourValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).IndexOfAnyFourValues(Size%3a%20512).html>) 4.74 μs 2.84 μs 0.60 0.10 False
[IndexOfAnyTwoValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Span(Char).IndexOfAnyTwoValues(Size%3a%20512).html>) 2.58 μs 1.40 μs 0.54 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Char&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Span<Char>.GetPinnableReference(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.26624365859715 < 21.418261189188303. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 42.87304564598087 (T) = (0 -18.50116856690675) / Math.Sqrt((0.39990988138635397 / (299)) + (0.25464686214832616 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15275211855477683 = (21.836783510568033 - 18.50116856690675) / 21.836783510568033 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.LastIndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 863.3757227915161 < 1.5140155193155977. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.86531710342896 (T) = (0 -873.2156016227693) / Math.Sqrt((90048.058866501 / (299)) + (518.6645451834029 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1660084574617228 = (1047.0317228459087 - 873.2156016227693) / 1047.0317228459087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.Fill(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0222582077390236 < 3.8348072225235295. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.11114306694224 (T) = (0 -2020.3495298835157) / Math.Sqrt((787096.6336275885 / (299)) + (2564.2288766796373 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.2057177356457944 = (2543.616571277931 - 2020.3495298835157) / 2543.616571277931 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.EndsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 442.1194613924973 < 660.6034976704622. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.516076355599933 (T) = (0 -446.3065651801759) / Math.Sqrt((12097.848173117132 / (299)) + (161.02210000690985 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11159478801557086 = (502.3682427338103 - 446.3065651801759) / 502.3682427338103 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.IndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 999.5730928347426 < 1.673758187890608. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.317919449275783 (T) = (0 -1011.9897387665275) / Math.Sqrt((99331.23977277736 / (299)) + (171.7975983938179 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15731943696722658 = (1200.9173857344201 - 1011.9897387665275) / 1200.9173857344201 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.SequenceEqual(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 765.076753385206 < 1.1942812462742225. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.882885230876155 (T) = (0 -768.9648982027389) / Math.Sqrt((43747.630303429534 / (299)) + (386.2930935664307 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12509847530896823 = (878.9159425391287 - 768.9648982027389) / 878.9159425391287 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.Clear(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.55238635419968 < 89.1847657066795. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.65356319055538 (T) = (0 -75.52908881162661) / Math.Sqrt((51.712357948668696 / (299)) + (6.277900721179609 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08237168862838316 = (82.30902193801123 - 75.52908881162661) / 82.30902193801123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.StartsWith(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 438.40512380488593 < 656.8778666775615. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.461808788796505 (T) = (0 -445.08345510852183) / Math.Sqrt((12600.712159857138 / (299)) + (291.6895607144502 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10352430945227148 = (496.48134333300754 - 445.08345510852183) / 496.48134333300754 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.SequenceCompareTo(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2166656535343199 < 1.7443326855523023. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.168324517110388 (T) = (0 -1133.4910592455542) / Math.Sqrt((65647.12720496957 / (299)) + (1246.6145831787333 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17237008116878033 = (1369.5626915545442 - 1133.4910592455542) / 1369.5626915545442 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.LastIndexOfAnyValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.257758870549511 < 7.259081339456687. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.558099426411687 (T) = (0 -4153.424494794333) / Math.Sqrt((2040714.384728479 / (299)) + (15506.825469239955 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17648117201423205 = (5043.508847214982 - 4153.424494794333) / 5043.508847214982 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.BinarySearch(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 233.07190773575365 < 349.2380070408845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.332508775304872 (T) = (0 -237.55260118767345) / Math.Sqrt((2616.138813805614 / (299)) + (42.70573115935308 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11828157314151073 = (269.42002565837186 - 237.55260118767345) / 269.42002565837186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6188315799460278 < 3.089899546319649. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.947582204896049 (T) = (0 -2514.608610356637) / Math.Sqrt((125698.01761951928 / (299)) + (6823.478734722367 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.05240690278911095 = (2653.679746885076 - 2514.608610356637) / 2653.679746885076 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.IndexOfAnyFourValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.8418174248658863 < 4.512320101726654. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.939977180737022 (T) = (0 -2939.194545744398) / Math.Sqrt((664846.9195395908 / (299)) + (56406.52609856093 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11862464464893527 = (3334.7818587163397 - 2939.194545744398) / 3334.7818587163397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.IndexOfAnyTwoValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4016995467742561 < 2.431912077034289. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.703734734751114 (T) = (0 -1423.4843502478066) / Math.Sqrt((229396.149608446 / (299)) + (19903.716758003895 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.153869215287716 = (1682.3455380267771 - 1423.4843502478066) / 1682.3455380267771 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).MultiplyOperatorBenchmark.html>) 124.24 ns 74.67 ns 0.60 0.14 False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsAnyBenchmark.html>) 186.81 ns 105.44 ns 0.56 0.18 False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanOrEqualAnyBenchmark.html>) 166.68 ns 101.58 ns 0.61 0.15 False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).MinBenchmark.html>) 155.69 ns 88.41 ns 0.57 0.14 False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualAnyBenchmark.html>) 194.21 ns 111.76 ns 0.58 0.18 False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).MultiplyBenchmark.html>) 130.07 ns 75.32 ns 0.58 0.17 False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementOperatorBenchmark.html>) 93.77 ns 65.58 ns 0.70 0.17 False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).OneBenchmark.html>) 62.19 ns 42.36 ns 0.68 0.17 False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualityOperatorBenchmark.html>) 34.09 ns 21.29 ns 0.62 0.29 False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanOrEqualBenchmark.html>) 134.75 ns 80.41 ns 0.60 0.13 False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).DotBenchmark.html>) 100.28 ns 53.51 ns 0.53 0.16 False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanAnyBenchmark.html>) 186.22 ns 106.73 ns 0.57 0.21 False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractionOperatorBenchmark.html>) 124.40 ns 74.28 ns 0.60 0.16 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).DivideBenchmark.html>) 129.26 ns 89.83 ns 0.69 0.13 False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).DivisionOperatorBenchmark.html>) 138.74 ns 81.87 ns 0.59 0.11 False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanAnyBenchmark.html>) 161.31 ns 100.17 ns 0.62 0.16 False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).MaxBenchmark.html>) 152.89 ns 89.00 ns 0.58 0.16 False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanAllBenchmark.html>) 222.69 ns 126.77 ns 0.57 0.16 False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualBenchmark.html>) 144.04 ns 92.26 ns 0.64 0.15 False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).InequalityOperatorBenchmark.html>) 36.10 ns 21.45 ns 0.59 0.27 False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanOrEqualAllBenchmark.html>) 235.07 ns 137.88 ns 0.59 0.16 False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).AddOperatorBenchmark.html>) 124.30 ns 73.56 ns 0.59 0.13 False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).UnaryNegateOperatorBenchmark.html>) 126.98 ns 73.69 ns 0.58 0.18 False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsAllBenchmark.html>) 33.91 ns 21.39 ns 0.63 0.23 False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).ConditionalSelectBenchmark.html>) 207.86 ns 153.68 ns 0.74 0.33 False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsStaticBenchmark.html>) 131.60 ns 75.80 ns 0.58 0.13 False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).AndNotBenchmark.html>) 135.70 ns 89.69 ns 0.66 0.23 False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).AddBenchmark.html>) 131.03 ns 76.36 ns 0.58 0.20 False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementBenchmark.html>) 94.76 ns 65.64 ns 0.69 0.24 False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractBenchmark.html>) 127.65 ns 75.04 ns 0.59 0.17 False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanBenchmark.html>) 132.06 ns 75.66 ns 0.57 0.12 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).SquareRootBenchmark.html>) 107.11 ns 74.12 ns 0.69 0.15 False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).NegateBenchmark.html>) 129.01 ns 75.41 ns 0.58 0.17 False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanAllBenchmark.html>) 233.50 ns 137.62 ns 0.59 0.20 False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GetHashCodeBenchmark.html>) 546.84 ns 399.33 ns 0.73 0.03 False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanBenchmark.html>) 135.70 ns 84.80 ns 0.62 0.17 False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualAllBenchmark.html>) 222.68 ns 134.43 ns 0.60 0.16 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.66842831256339 < 118.68271023752982. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.762704028058426 (T) = (0 -74.89930612939109) / Math.Sqrt((403.1418605447384 / (299)) + (7.149670761173063 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1603311492332993 = (89.20100592156136 - 74.89930612939109) / 89.20100592156136 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.44020392574389 < 181.17989013296784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.020431039005565 (T) = (0 -108.27493213386792) / Math.Sqrt((1051.58257998402 / (299)) + (74.69596859987179 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1693177758219077 = (130.3445878368219 - 108.27493213386792) / 130.3445878368219 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.57981049832215 < 158.37658780304994. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.328401576596733 (T) = (0 -99.41149396314071) / Math.Sqrt((873.540374663711 / (299)) + (14.050692190351489 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1299245047185582 = (114.2561703004683 - 99.41149396314071) / 114.2561703004683 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.41222462835016 < 148.1980726150732. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.074760333760944 (T) = (0 -89.4263059302858) / Math.Sqrt((684.5043171167838 / (299)) + (8.272355520571148 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18582944110237512 = (109.83731228425617 - 89.4263059302858) / 109.83731228425617 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 111.7616406482128 < 185.71023927395493. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.395318549313238 (T) = (0 -113.5086572208485) / Math.Sqrt((1567.5605125194106 / (299)) + (8.929768309251122 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16134287120610286 = (135.345725116639 - 113.5086572208485) / 135.345725116639 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.31957543050568 < 121.41482996868943. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.770090911685754 (T) = (0 -76.80377820859991) / Math.Sqrt((410.01217809619334 / (299)) + (5.427116923337703 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16776749148355385 = (92.28644329877454 - 76.80377820859991) / 92.28644329877454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.57760244059172 < 89.05974480786482. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.7062876714653 (T) = (0 -67.54386246623031) / Math.Sqrt((120.4919955376538 / (299)) + (11.138996723884087 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10950736433345738 = (75.8499955652896 - 67.54386246623031) / 75.8499955652896 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.36119467098386 < 58.94383875718033. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.73406416996583 (T) = (0 -43.06436230729015) / Math.Sqrt((64.61642454117548 / (299)) + (2.079071396837197 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10212956435651462 = (47.96278014926152 - 43.06436230729015) / 47.96278014926152 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.291923551923773 < 32.63315623134778. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.727463709541293 (T) = (0 -22.06866976411924) / Math.Sqrt((28.655171565937433 / (299)) + (2.627284482524229 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11714785380498707 = (24.9970166117085 - 22.06866976411924) / 24.9970166117085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.40810797504791 < 128.01007993420993. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.404933613203545 (T) = (0 -81.00733262888991) / Math.Sqrt((549.7561404267553 / (299)) + (5.419728092105127 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1391118758604839 = (94.09739820706577 - 81.00733262888991) / 94.09739820706577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.510841757345524 < 95.13499066085244. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.168527472701776 (T) = (0 -54.79150957991417) / Math.Sqrt((295.83912357029476 / (299)) + (10.588606213898457 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.21944049179258948 = (70.19517282640666 - 54.79150957991417) / 70.19517282640666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.72505609304241 < 178.19387888106579. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.10069350995747 (T) = (0 -109.22020687098129) / Math.Sqrt((1024.970284557566 / (299)) + (17.22515904746289 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16418600891979748 = (130.67525554319275 - 109.22020687098129) / 130.67525554319275 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.27956957273089 < 118.20397124784013. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.438998670814119 (T) = (0 -74.30311439105945) / Math.Sqrt((422.2223067289753 / (299)) + (9.914946273047953 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16253048022427175 = (88.72336561091512 - 74.30311439105945) / 88.72336561091512 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.83400980175088 < 122.75411472161923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.025371569578555 (T) = (0 -85.21863843836373) / Math.Sqrt((322.3188338066318 / (299)) + (4.775187990715791 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1320918951954755 = (98.18855010872053 - 85.21863843836373) / 98.18855010872053 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.86578246274087 < 124.08693099443623. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.412762475993121 (T) = (0 -82.93203495384014) / Math.Sqrt((326.27656140989063 / (299)) + (2.89229561472079 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1379868106132379 = (96.20738519423138 - 82.93203495384014) / 96.20738519423138 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.17036571216687 < 154.07516033069354. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.846974268547932 (T) = (0 -93.29695133418757) / Math.Sqrt((810.9415802220193 / (299)) + (6.2702809055123785 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17586590084205667 = (113.20603216092316 - 93.29695133418757) / 113.20603216092316 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.00213536708344 < 145.34063183736242. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.785015841878414 (T) = (0 -89.78921345117166) / Math.Sqrt((688.13201657917 / (299)) + (4.424219792029737 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1684447659449251 = (107.9774496918443 - 89.78921345117166) / 107.9774496918443 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 126.77026495584524 < 201.63715747528104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.217612874548385 (T) = (0 -124.54323644097623) / Math.Sqrt((993.6801404628065 / (299)) + (11.66023730606241 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18674068201927915 = (153.14086624941524 - 124.54323644097623) / 153.14086624941524 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 92.25791771711286 < 130.80358690990388. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.713082958814569 (T) = (0 -82.16439777378528) / Math.Sqrt((589.4783288958891 / (299)) + (10.40693946956459 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1480436142533892 = (96.44202349839848 - 82.16439777378528) / 96.44202349839848 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.45231999907891 < 34.33755717993435. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.367951073078107 (T) = (0 -22.215517963618655) / Math.Sqrt((37.02494902859719 / (299)) + (2.0919164124106584 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13160049712668812 = (25.582140351431786 - 22.215517963618655) / 25.582140351431786 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.8840774923576 < 222.90940111960023. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.881803815834784 (T) = (0 -138.6718508347146) / Math.Sqrt((1330.476468977691 / (299)) + (9.581207204436344 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18744744340226116 = (170.66200790180432 - 138.6718508347146) / 170.66200790180432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.5556822360665 < 117.44634359306349. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.894077097245175 (T) = (0 -74.38121621857499) / Math.Sqrt((416.77914904992605 / (299)) + (6.810582403751279 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16447783934781876 = (89.02363063657755 - 74.38121621857499) / 89.02363063657755 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.69409143320655 < 120.93468577778101. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.647351011372232 (T) = (0 -74.68386789162162) / Math.Sqrt((428.1599565390073 / (299)) + (1.9425604730644253 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1812340050904113 = (91.21515592482379 - 74.68386789162162) / 91.21515592482379 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.392752983694017 < 32.42730172200685. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.208650161636932 (T) = (0 -21.54389095495493) / Math.Sqrt((34.9530400463526 / (299)) + (1.524646158857238 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1396158800305273 = (25.039851916048065 - 21.54389095495493) / 25.039851916048065 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 153.68249860288947 < 197.577309877098. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.5730729604428 (T) = (0 -150.16459542572895) / Math.Sqrt((596.3649969379909 / (299)) + (18.955379643123436 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09733788765646338 = (166.35748124607125 - 150.16459542572895) / 166.35748124607125 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.79879208466855 < 124.9009422692443. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.878244468790768 (T) = (0 -76.64208365473814) / Math.Sqrt((493.97288306140086 / (299)) + (2.266663460028826 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16779764140479553 = (92.09548959235525 - 76.64208365473814) / 92.09548959235525 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.68995840278698 < 119.86275289621175. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.176334693070759 (T) = (0 -92.34713349383802) / Math.Sqrt((239.58768442621843 / (299)) + (23.279268374590004 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08898292160249797 = (101.36707168682122 - 92.34713349383802) / 101.36707168682122 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.36378532965236 < 122.7259376151022. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.40190363002304 (T) = (0 -77.10433240140534) / Math.Sqrt((420.1191210312609 / (299)) + (6.24736861905801 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16542671358443822 = (92.38773113930289 - 77.10433240140534) / 92.38773113930289 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.63763522410514 < 89.57120455883063. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.950223998973291 (T) = (0 -67.55717772114073) / Math.Sqrt((129.73828557756045 / (299)) + (6.386063804435367 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11577987955556086 = (76.40312198187053 - 67.55717772114073) / 76.40312198187053 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.03858565015533 < 121.45297318948762. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.764942849230124 (T) = (0 -76.58494046463441) / Math.Sqrt((440.1650974265132 / (299)) + (10.569082545811554 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16540118132567042 = (91.76257951848213 - 76.58494046463441) / 91.76257951848213 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.6591339368789 < 125.57044891869558. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.517949655864406 (T) = (0 -76.47042502926912) / Math.Sqrt((493.35027458369706 / (299)) + (1.9872882735942252 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17527225060285836 = (92.72202261311975 - 76.47042502926912) / 92.72202261311975 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.11510783857128 < 101.883697768343. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.128910394921766 (T) = (0 -74.87333263184289) / Math.Sqrt((176.55055618478906 / (299)) + (3.392585446348091 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10708825591325738 = (83.85300465324516 - 74.87333263184289) / 83.85300465324516 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.40510577337962 < 120.8051974446721. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.643270565671859 (T) = (0 -75.32302876829515) / Math.Sqrt((425.7836319329032 / (299)) + (7.402040979924253 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1732503562564162 = (91.10742210571374 - 75.32302876829515) / 91.10742210571374 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.62473680154093 < 222.01516280264988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.66490553657384 (T) = (0 -135.99126259605856) / Math.Sqrt((1194.5845455182182 / (299)) + (15.220902632617431 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.20200302412560475 = (170.41576184802935 - 135.99126259605856) / 170.41576184802935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 399.32621588609237 < 523.9084651625899. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.994447773933082 (T) = (0 -402.3132858886896) / Math.Sqrt((3183.735655422901 / (299)) + (52.134229082665456 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10583797482942447 = (449.9333169644976 - 402.3132858886896) / 449.9333169644976 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.80143420542996 < 127.17891304490313. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.75714534310947 (T) = (0 -78.22444113976758) / Math.Sqrt((501.01252080422455 / (299)) + (9.032789460657693 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15710011639536847 = (92.80395295019323 - 78.22444113976758) / 92.80395295019323 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 134.42656301535098 < 206.14722463390117. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.637333232179548 (T) = (0 -128.43843709532456) / Math.Sqrt((1113.6760023695472 / (299)) + (14.02845627835688 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18514970112868898 = (157.62212675534502 - 128.43843709532456) / 157.62212675534502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToString(value%3a%20-3.4028235E%2b38).html>) 3.64 μs 2.89 μs 0.79 0.19 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.Parse(value%3a%20%22-3.4028235E%2b38%22).html>) 1.73 μs 1.19 μs 0.68 0.03 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22G%22).html>) 2.51 μs 1.82 μs 0.73 0.03 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.Parse(value%3a%20%2212345%22).html>) 1.12 μs 782.38 ns 0.70 0.07 False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithCultureInfo(value%3a%2012345%2c%20culture%3a%20zh).html>) 2.34 μs 1.73 μs 0.74 0.03 False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToString(value%3a%2012345).html>) 2.38 μs 1.78 μs 0.75 0.04 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.TryParse(value%3a%20%22-3.4028235E%2b38%22).html>) 1.75 μs 1.15 μs 0.66 0.04 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22G17%22).html>) 4.16 μs 3.17 μs 0.76 0.08 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%203.4028235E%2b38%2c%20format%3a%20%22G%22).html>) 3.72 μs 3.00 μs 0.81 0.14 False
[IsNaN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.IsNaN(value%3a%20NaN).html>) 14.85 ms 8.01 ms 0.54 0.08 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%203.4028235E%2b38%2c%20format%3a%20%22E%22).html>) 2.31 μs 1.82 μs 0.79 0.09 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22R%22).html>) 2.39 μs 1.83 μs 0.77 0.02 False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithCultureInfo(value%3a%20-3.4028235E%2b38%2c%20culture%3a%20zh).html>) 3.70 μs 2.74 μs 0.74 0.16 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.TryParse(value%3a%20%223.4028235E%2b38%22).html>) 1.68 μs 1.15 μs 0.68 0.04 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.TryParse(value%3a%20%2212345%22).html>) 1.10 μs 791.71 ns 0.72 0.04 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%203.4028235E%2b38%2c%20format%3a%20%22F50%22).html>) 30.62 μs 20.94 μs 0.68 0.02 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%20-3.4028235E%2b38%2c%20format%3a%20%22E%22).html>) 2.40 μs 1.81 μs 0.76 0.10 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%20-3.4028235E%2b38%2c%20format%3a%20%22R%22).html>) 4.05 μs 3.17 μs 0.78 0.11 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%20-3.4028235E%2b38%2c%20format%3a%20%22G17%22).html>) 3.61 μs 2.73 μs 0.76 0.24 False
[IsNaN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.IsNaN(value%3a%200).html>) 14.85 ms 9.05 ms 0.61 0.03 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22E%22).html>) 2.34 μs 1.81 μs 0.78 0.07 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%20-3.4028235E%2b38%2c%20format%3a%20%22F50%22).html>) 30.63 μs 21.14 μs 0.69 0.02 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%203.4028235E%2b38%2c%20format%3a%20%22G17%22).html>) 3.55 μs 2.58 μs 0.73 0.29 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.Parse(value%3a%20%223.4028235E%2b38%22).html>) 1.69 μs 1.23 μs 0.73 0.02 False
[ToStringWithFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithFormat(value%3a%2012345%2c%20format%3a%20%22F50%22).html>) 6.18 μs 4.82 μs 0.78 0.02 False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToString(value%3a%203.4028235E%2b38).html>) 3.68 μs 2.72 μs 0.74 0.15 False
[ToStringWithCultureInfo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Single.ToStringWithCultureInfo(value%3a%203.4028235E%2b38%2c%20culture%3a%20zh).html>) 3.64 μs 2.82 μs 0.78 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Single*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Single.ToString(value: -3.4028235E+38) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.890373600973235 < 3.4255065146351718. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.056844124179118 (T) = (0 -2932.4077935208647) / Math.Sqrt((106119.67640738335 / (299)) + (5179.727277327775 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05492378811138073 = (3102.8267949531883 - 2932.4077935208647) / 3102.8267949531883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.Parse(value: "-3.4028235E+38") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1864535662659768 < 1.643061930903005. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.872639346767457 (T) = (0 -1178.537101533281) / Math.Sqrt((63618.34509946921 / (299)) + (246.0962376191153 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06840855837696384 = (1265.079356547127 - 1178.537101533281) / 1265.079356547127 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8242169860143962 < 2.260980901602653. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.477300081945403 (T) = (0 -1822.1130858575373) / Math.Sqrt((59997.71029878333 / (299)) + (810.3210498885488 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0567724600514575 = (1931.785289005601 - 1822.1130858575373) / 1931.785289005601 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.Parse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 782.3779242375974 < 1.0613864572668026. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.149223633951 (T) = (0 -802.6900546348916) / Math.Sqrt((22293.912293420166 / (299)) + (118.35935077184213 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06287880191919376 = (856.5488181024767 - 802.6900546348916) / 856.5488181024767 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 12345, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7302132799710706 < 2.2177123214282464. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.826097751731211 (T) = (0 -1782.0392625745312) / Math.Sqrt((58440.599233447465 / (299)) + (735.899384184105 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05964465053398946 = (1895.0700536626698 - 1782.0392625745312) / 1895.0700536626698 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7800227285980874 < 2.2296587190024804. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.90299099092079 (T) = (0 -1798.8503194333546) / Math.Sqrt((60235.35859155761 / (299)) + (948.5767589752883 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05370282036210404 = (1900.935940780983 - 1798.8503194333546) / 1900.935940780983 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1498846442298092 < 1.6398882917588524. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.857547819942648 (T) = (0 -1164.8837080320332) / Math.Sqrt((63734.417516899775 / (299)) + (203.0168160751069 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07977381728807512 = (1265.8667291981387 - 1164.8837080320332) / 1265.8667291981387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.1705368220966217 < 3.8782477811867953. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.87635059328244 (T) = (0 -3266.6165203153782) / Math.Sqrt((78710.06603354876 / (299)) + (4095.0648403779264 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08655128518492639 = (3576.1356574645793 - 3266.6165203153782) / 3576.1356574645793 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.002143736039313 < 3.5975094792985427. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.247218434087215 (T) = (0 -3004.359279645286) / Math.Sqrt((120351.785540855 / (299)) + (5223.877442726019 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05097413409050795 = (3165.729605026181 - 3004.359279645286) / 3165.729605026181 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.IsNaN(value: NaN) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.006181870535714 < 14.112949108816965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.050876727475304 (T) = (0 -8037406.008233787) / Math.Sqrt((8398364850730.701 / (299)) + (62612579698.56181 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17608033990475647 = (9755084.624761445 - 8037406.008233787) / 9755084.624761445 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8188155374251496 < 2.2024307522125977. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.923321831057958 (T) = (0 -1811.4764903392468) / Math.Sqrt((57279.342626742044 / (299)) + (1308.039310295287 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05305804267683824 = (1912.975210708766 - 1811.4764903392468) / 1912.975210708766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "R") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8301493517752294 < 2.27351661316592. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.1320729345321325 (T) = (0 -1843.5365601367505) / Math.Sqrt((59915.9766419509 / (299)) + (779.6038016788045 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.053660344845858896 = (1948.0707060051 - 1843.5365601367505) / 1948.0707060051 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: -3.4028235E+38, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7390029416961124 < 3.495169073906185. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.016007285632705 (T) = (0 -2899.15615477421) / Math.Sqrt((102531.80026910038 / (299)) + (4894.046220278578 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06070644159314962 = (3086.528305050352 - 2899.15615477421) / 3086.528305050352 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.148884234497141 < 1.6050983681063982. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.760442478093338 (T) = (0 -1157.1137181675142) / Math.Sqrt((54345.772018000476 / (299)) + (254.22162030762203 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0738553754811828 = (1249.3877171383444 - 1157.1137181675142) / 1249.3877171383444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.TryParse(value: "12345") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 791.7104050794795 < 1.0697911576150714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.0004330065139735 (T) = (0 -791.7300326890102) / Math.Sqrt((21608.855152738357 / (299)) + (139.4802457743761 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07104171563971363 = (852.2772723150034 - 791.7300326890102) / 852.2772723150034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.939843758344463 < 29.14994736718815. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.875472151759094 (T) = (0 -21109.718390451275) / Math.Sqrt((17316722.408382226 / (299)) + (76643.47359912943 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12047226482490916 = (24001.19694491372 - 21109.718390451275) / 24001.19694491372 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8142969335480095 < 2.253163546935003. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.08111337289674 (T) = (0 -1840.6017557627497) / Math.Sqrt((61864.4149720146 / (299)) + (1223.0106532387044 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.054986307064062344 = (1947.698503758637 - 1840.6017557627497) / 1947.698503758637 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "R") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.1744318227540758 < 3.7297364178884873. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.317264962541152 (T) = (0 -3128.1968965902065) / Math.Sqrt((125936.76339156428 / (299)) + (5757.372352937514 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05082396256561471 = (3295.697292407103 - 3128.1968965902065) / 3295.697292407103 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.729766795820124 < 3.302789838746689. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.713889890350513 (T) = (0 -2660.3588240108834) / Math.Sqrt((140292.14855816192 / (299)) + (5561.2168806457 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05675798083268547 = (2820.441381904746 - 2660.3588240108834) / 2820.441381904746 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.IsNaN(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.051287135416667 < 14.110287038537946. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.95480644319138 (T) = (0 -8025463.746000146) / Math.Sqrt((8097304490720.539 / (299)) + (59231728685.64932 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17228456984623164 = (9695921.3923428 - 8025463.746000146) / 9695921.3923428 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "E") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8122045064649297 < 2.2345191955124166. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.147248477259085 (T) = (0 -1821.1522751099096) / Math.Sqrt((58273.48538161129 / (299)) + (941.2196408829026 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06115532118006418 = (1939.7801534104392 - 1821.1522751099096) / 1939.7801534104392 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.142490419884172 < 29.486245157764905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.730793803740434 (T) = (0 -21364.454391142997) / Math.Sqrt((14201085.115113275 / (299)) + (287229.51585649705 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11186815546516812 = (24055.49865440626 - 21364.454391142997) / 24055.49865440626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G17") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.583367040234656 < 3.2214820864087494. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.582925796182131 (T) = (0 -2588.7764904892174) / Math.Sqrt((135473.37018988802 / (299)) + (8377.193472013189 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05875830862751377 = (2750.384427526104 - 2588.7764904892174) / 2750.384427526104 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.Parse(value: "3.4028235E+38") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2296920639171576 < 1.5863889696592814. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.181615583333057 (T) = (0 -1165.5590694952512) / Math.Sqrt((54500.581561567946 / (299)) + (271.2396458599074 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06764109830303112 = (1250.1184547858545 - 1165.5590694952512) / 1250.1184547858545 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "F50") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.824431371790906 < 5.916782057877164. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.898380879398585 (T) = (0 -4915.084429573974) / Math.Sqrt((270735.29321175616 / (299)) + (3778.5081902150255 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08638074350159308 = (5379.795133053377 - 4915.084429573974) / 5379.795133053377 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToString(value: 3.4028235E+38) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.7206155022734713 < 3.397128014023366. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.43272709599606 (T) = (0 -2874.875252755618) / Math.Sqrt((106454.27731356518 / (299)) + (6264.40111403012 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.05318446408106905 = (3036.3625687293043 - 2874.875252755618) / 3036.3625687293043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 3.4028235E+38, culture: zh) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.823432795417051 < 3.3868945110903987. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.404930978625698 (T) = (0 -2840.172579975707) / Math.Sqrt((100703.02713031099 / (299)) + (5970.665057126577 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05878065125487751 = (3017.5458927425975 - 2840.172579975707) / 3017.5458927425975 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<ArrayList>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ArrayList).SerializeToUtf8Bytes.html>) 256.79 μs 167.11 μs 0.65 0.04 False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ArrayList).SerializeObjectProperty.html>) 270.50 μs 188.85 μs 0.70 0.02 False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ArrayList).SerializeToStream.html>) 268.90 μs 173.20 μs 0.64 0.02 False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ArrayList).SerializeToString.html>) 269.23 μs 179.32 μs 0.67 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ArrayList&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 167.1083698708207 < 242.0462445629792. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.819323181829057 (T) = (0 -169289.94720449028) / Math.Sqrt((1205396140.3211467 / (299)) + (4092491.382983289 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11463604119028896 = (191209.4405018302 - 169289.94720449028) / 191209.4405018302 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.84639890873015 < 257.77284879849134. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.931193534843688 (T) = (0 -185702.7744294456) / Math.Sqrt((1288690165.7608397 / (299)) + (8831923.273537466 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10155833944639572 = (206694.30479773026 - 185702.7744294456) / 206694.30479773026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 173.19897449074077 < 247.1438246841762. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.493003994355663 (T) = (0 -174984.65669256946) / Math.Sqrt((1212163820.9575708 / (299)) + (5572041.541195326 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10892307358497537 = (196374.35501395675 - 174984.65669256946) / 196374.35501395675 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ArrayList>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 179.3215036221591 < 256.6261860657753. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.787108031844555 (T) = (0 -180385.59647204715) / Math.Sqrt((1305850885.6883848 / (299)) + (12004368.827028273 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10413293785268805 = (201353.0847307627 - 180385.59647204715) / 201353.0847307627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>) 41.16 μs 27.07 μs 0.66 0.31 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>) 41.70 μs 26.95 μs 0.65 0.05 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 587.23 ns 449.48 ns 0.77 0.11 False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>) 37.59 μs 23.35 μs 0.62 0.19 False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>) 64.53 μs 43.51 μs 0.67 0.31 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>) 40.95 μs 26.01 μs 0.64 0.06 False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>) 39.61 μs 25.35 μs 0.64 0.18 False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 65.54 μs 43.38 μs 0.66 0.26 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>) 309.12 ns 226.18 ns 0.73 0.15 False
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 37.61 μs 24.56 μs 0.65 0.19 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 36.44 μs 22.28 μs 0.61 0.09 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>) 2.75 μs 2.38 μs 0.87 0.02 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>) 2.39 μs 2.08 μs 0.87 0.01 False
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>) 36.18 μs 22.00 μs 0.61 0.06 False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20True).html>) 67.50 μs 45.74 μs 0.68 0.28 False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20True%2c%20UseSharedPool%3a%20False).html>) 68.14 μs 46.71 μs 0.69 0.22 False
[SingleParallel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleParallel(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20True).html>) 592.11 ns 467.83 ns 0.79 0.23 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.0694817685 < 38.99096933757499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.341784023122812 (T) = (0 -27373.063709054488) / Math.Sqrt((38955718.701644786 / (299)) + (768320.211453638 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09245173876652137 = (30161.55159820466 - 27373.063709054488) / 30161.55159820466 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.95131945285714 < 39.6568830820064. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.244506333581754 (T) = (0 -26982.140452185024) / Math.Sqrt((41032580.65285776 / (299)) + (1253200.4029683156 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.108792485906257 = (30275.934645392663 - 26982.140452185024) / 30275.934645392663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 449.47903958333336 < 565.0435382416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.634492946438222 (T) = (0 -456.4939461633416) / Math.Sqrt((3063.5339462991433 / (299)) + (79.96595564629573 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08010482856129982 = (496.24561617101756 - 456.4939461633416) / 496.24561617101756 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.34893168428572 < 35.74531863986429. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.752952946991984 (T) = (0 -24017.97829378641) / Math.Sqrt((41097055.7360488 / (299)) + (3145087.644621678 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11009453114992342 = (26989.359133641585 - 24017.97829378641) / 26989.359133641585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.50905707846154 < 61.297609498013735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.72812173773161 (T) = (0 -44836.109446406655) / Math.Sqrt((63151596.40510759 / (299)) + (1953665.7636713034 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10610476435086437 = (50158.12553676632 - 44836.109446406655) / 50158.12553676632 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.005989640000003 < 38.90848728605929. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.409034149602912 (T) = (0 -26251.817258408795) / Math.Sqrt((42062278.01984471 / (299)) + (662238.5576561829 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11118271960071607 = (29535.673796323666 - 26251.817258408795) / 29535.673796323666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.346351768461528 < 38.02476841474588. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.6255754032132055 (T) = (0 -25943.41267152532) / Math.Sqrt((39998059.44208915 / (299)) + (1504633.3203948173 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10553504583601478 = (29004.392570945856 - 25943.41267152532) / 29004.392570945856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.37605605666667 < 62.10931376013333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.55983721349506 (T) = (0 -45407.59804898837) / Math.Sqrt((64853947.12740948 / (299)) + (4222171.6878187675 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10240726886623333 = (50588.19715666944 - 45407.59804898837) / 50588.19715666944 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.1833310909091 < 296.76747777291666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.194235593004487 (T) = (0 -231.22194931425076) / Math.Sqrt((1042.7644115828346 / (299)) + (27.498523777560585 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08091525381140807 = (251.57848639433854 - 231.22194931425076) / 251.57848639433854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.555552826666666 < 35.73760949737435. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.965915724229515 (T) = (0 -24376.010110295156) / Math.Sqrt((47453434.16750538 / (299)) + (1753265.727669943 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09640163331520256 = (26976.598242123924 - 24376.010110295156) / 26976.598242123924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.276634991999998 < 34.626568118300824. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.353668959537709 (T) = (0 -22372.247633964773) / Math.Sqrt((41002776.55426191 / (299)) + (122347.62832075755 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12233770056268693 = (25490.72422081713 - 22372.247633964773) / 25490.72422081713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.382763773333333 < 2.5809807035083336. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.342041305418757 (T) = (0 -2374.0622129545122) / Math.Sqrt((14766.894861343348 / (299)) + (1247.0813081939666 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.058389152088560534 = (2521.2774663974537 - 2374.0622129545122) / 2521.2774663974537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0779198733333337 < 2.2741778474166665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.05404329188674 (T) = (0 -2059.4372732929096) / Math.Sqrt((11364.23287110273 / (299)) + (1025.9951126289673 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.055272331052146885 = (2179.9269154321614 - 2059.4372732929096) / 2179.9269154321614 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.99770849733334 < 34.37406827290476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.350569543034942 (T) = (0 -22066.752097620712) / Math.Sqrt((38371753.38194196 / (299)) + (100018.99327602235 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12012279331214136 = (25079.35417566626 - 22066.752097620712) / 25079.35417566626 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 45.74488744785714 < 64.44547661189999. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.149568127683311 (T) = (0 -47695.169527182) / Math.Sqrt((64326285.39767003 / (299)) + (2905611.03497954 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09906942294610137 = (52939.894307004535 - 47695.169527182) / 52939.894307004535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 46.71055873733333 < 64.83944435520594. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.189726682135145 (T) = (0 -48821.13410713332) / Math.Sqrt((60959350.15748733 / (299)) + (5206651.264460265 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09350514229508786 = (53857.04473905122 - 48821.13410713332) / 53857.04473905122 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 467.83452562499997 < 557.4657703923612. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.228936348321048 (T) = (0 -481.2206405671694) / Math.Sqrt((1880.8200933433798 / (299)) + (183.19056617454353 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.0563162893128244 = (509.93848374976415 - 481.2206405671694) / 509.93848374976415 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Globalization.Tests.StringSearch

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20False)).html>) 13.57 μs 8.21 μs 0.61 0.10 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20True)).html>) 26.04 μs 20.69 μs 0.79 0.05 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 13.53 μs 8.15 μs 0.60 0.14 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 4.87 μs 3.30 μs 0.68 0.12 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 435.80 ns 295.35 ns 0.68 0.15 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 168.32 ns 125.89 ns 0.75 0.24 False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 1.82 μs 1.11 μs 0.61 0.08 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>) 4.90 μs 3.30 μs 0.67 0.11 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 4.91 μs 3.35 μs 0.68 0.14 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(%2c%20None%2c%20False)).html>) 280.22 ns 184.29 ns 0.66 0.23 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) 800.51 ns 531.37 ns 0.66 0.07 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(%2c%20None%2c%20False)).html>) 5.01 μs 3.34 μs 0.67 0.10 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 13.74 μs 8.19 μs 0.60 0.10 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20True)).html>) 26.29 μs 20.68 μs 0.79 0.03 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) 1.49 μs 944.67 ns 0.64 0.04 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(%2c%20None%2c%20False)).html>) 4.95 μs 3.32 μs 0.67 0.09 False
[IsPrefix_FirstHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>) 4.90 μs 3.40 μs 0.69 0.14 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 258.96 ns 184.19 ns 0.71 0.20 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 4.95 μs 3.32 μs 0.67 0.13 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 260.39 ns 192.16 ns 0.74 0.22 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 260.19 ns 186.36 ns 0.72 0.28 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>) 269.05 ns 196.41 ns 0.73 0.25 False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(%2c%20None%2c%20False)).html>) 13.54 μs 8.19 μs 0.61 0.12 False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 13.57 μs 8.19 μs 0.60 0.11 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>) 269.68 ns 192.61 ns 0.71 0.28 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>) 276.04 ns 188.81 ns 0.68 0.23 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 669.62 ns 436.41 ns 0.65 0.09 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) 827.00 ns 539.90 ns 0.65 0.06 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) 167.39 ns 127.97 ns 0.76 0.20 False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>) 265.81 ns 189.11 ns 0.71 0.26 False
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 13.57 μs 8.22 μs 0.61 0.11 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 422.43 ns 300.64 ns 0.71 0.12 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20None%2c%20False)).html>) 264.53 ns 200.19 ns 0.76 0.24 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20OrdinalIgnoreCase%2c%20False)).html>) 13.37 μs 8.56 μs 0.64 0.09 False
[LastIndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) 1.71 μs 1.03 μs 0.60 0.05 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(%2c%20IgnoreCase%2c%20False)).html>) 4.96 μs 3.36 μs 0.68 0.15 False
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(%2c%20None%2c%20False)).html>) 259.81 ns 184.33 ns 0.71 0.26 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20IgnoreCase%2c%20False)).html>) 4.89 μs 3.38 μs 0.69 0.12 False
[IsSuffix_SecondHalf - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options%3a%20(en-US%2c%20IgnoreNonSpace%2c%20False)).html>) 4.91 μs 3.36 μs 0.68 0.16 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.212157353080121 < 12.878946100428166. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.615371134773262 (T) = (0 -8260.289052155096) / Math.Sqrt((4626528.694869587 / (299)) + (159131.11739074704 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15987632053125345 = (9832.229770476773 - 8260.289052155096) / 9832.229770476773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, True)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.687541147902873 < 24.757830704686338. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.977281592324927 (T) = (0 -20786.72701591382) / Math.Sqrt((4405105.070679049 / (299)) + (63950.5086399644 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0729675945819764 = (22422.86989583771 - 20786.72701591382) / 22422.86989583771 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.151666795780814 < 12.900642252875477. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.863625552045386 (T) = (0 -8266.406320012891) / Math.Sqrt((4513157.981299602 / (299)) + (142360.90286606873 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1600817561683631 = (9841.917806550118 - 8266.406320012891) / 9841.917806550118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.2997641506444113 < 4.659549624688639. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.500064565857379 (T) = (0 -3375.8674516076685) / Math.Sqrt((386995.362689282 / (299)) + (14376.964622514322 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1182906675189555 = (3828.7759097528265 - 3375.8674516076685) / 3828.7759097528265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 295.3474342250004 < 396.25924140686004. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.652572626412796 (T) = (0 -287.556651680684) / Math.Sqrt((3114.032621090831 / (299)) + (50.554846778427724 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10146822787805906 = (320.02947542032973 - 287.556651680684) / 320.02947542032973 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 125.88739843018332 < 159.6524428384171. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.970503914417506 (T) = (0 -128.14210379930327) / Math.Sqrt((270.2593539701541 / (299)) + (15.890474271566935 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0923970570025855 = (141.1874044569601 - 128.14210379930327) / 141.1874044569601 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1142951318504308 < 1.7314982244252208. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.31726486055807 (T) = (0 -1118.4323882740432) / Math.Sqrt((93886.41423910126 / (299)) + (534.7159795645144 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.14238241774861624 = (1304.115507214741 - 1118.4323882740432) / 1304.115507214741 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.2999260273482243 < 4.624830451223659. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.632892448052074 (T) = (0 -3377.226321007141) / Math.Sqrt((377117.5201992439 / (299)) + (9620.847344485215 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11535332268609147 = (3817.5990569043465 - 3377.226321007141) / 3817.5990569043465 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3511938987457115 < 4.662461303213988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.520129204065542 (T) = (0 -3354.593405491113) / Math.Sqrt((371538.29362971993 / (299)) + (1734.771583884738 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1257454169783581 = (3837.089871347087 - 3354.593405491113) / 3837.089871347087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.28992795346963 < 245.44324788459863. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.675792996861098 (T) = (0 -189.4543982133541) / Math.Sqrt((794.9188695486896 / (299)) + (37.998452309983584 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10909168865101086 = (212.65308202870776 - 189.4543982133541) / 212.65308202870776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 531.3745526573715 < 765.8357415359739. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.950845674048407 (T) = (0 -547.4144617893244) / Math.Sqrt((12881.115295865053 / (299)) + (113.26195158173525 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08887481854887286 = (600.8114723790978 - 547.4144617893244) / 600.8114723790978 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3424559450891898 < 4.651009605311735. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.900139675320375 (T) = (0 -3354.445636506789) / Math.Sqrt((384992.52849927027 / (299)) + (3261.5583299483587 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12363858569163189 = (3827.6966349027884 - 3354.445636506789) / 3827.6966349027884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.192762695690416 < 12.90221465752689. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.121984624410313 (T) = (0 -8246.008734273124) / Math.Sqrt((4447879.602678065 / (299)) + (81617.75258535154 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1582679381764977 = (9796.476941141134 - 8246.008734273124) / 9796.476941141134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, True)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.68102989001892 < 24.846558657130117. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.200020314688539 (T) = (0 -20819.37431951753) / Math.Sqrt((4278622.0669928305 / (299)) + (129098.18814152418 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07022957737672557 = (22391.951618311643 - 20819.37431951753) / 22391.951618311643 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 944.6727052677296 < 1.4104835359496348. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.061808636177325 (T) = (0 -952.2167392182691) / Math.Sqrt((49887.61285157698 / (299)) + (100.83176254646992 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.109992783595473 = (1069.8977734866664 - 952.2167392182691) / 1069.8977734866664 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3209685304363767 < 4.676472156477483. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.384692645167888 (T) = (0 -3362.7119658197403) / Math.Sqrt((390785.0384690912 / (299)) + (987.5541967788306 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11819805908688807 = (3813.4549378941365 - 3362.7119658197403) / 3813.4549378941365 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.403720184007269 < 4.666819176936812. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.8808132557171 (T) = (0 -3344.5221062641567) / Math.Sqrt((366383.6924884238 / (299)) + (985.0719708232945 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12764444404517003 = (3833.897868173071 - 3344.5221062641567) / 3833.897868173071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.19349155534985 < 245.9844813460182. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.333363904569355 (T) = (0 -191.1317519579122) / Math.Sqrt((748.0425402290394 / (299)) + (59.20379117706448 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10060967129966104 = (212.5125719709556 - 191.1317519579122) / 212.5125719709556 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3211305799272424 < 4.69223016570133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.402455656585023 (T) = (0 -3362.5427222180692) / Math.Sqrt((645882.618940354 / (299)) + (1429.58780673777 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12635576512776595 = (3848.8695832919034 - 3362.5427222180692) / 3848.8695832919034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 192.15504912404415 < 246.14768011431968. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.581625456109213 (T) = (0 -191.2186641952234) / Math.Sqrt((758.3869675173289 / (299)) + (45.55150241000832 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09979154962576817 = (212.41598444863584 - 191.2186641952234) / 212.41598444863584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 186.359882161387 < 249.71088278297253. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.870270426143847 (T) = (0 -191.82813770055415) / Math.Sqrt((889.645697129513 / (299)) + (52.716168818108564 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10910362645758162 = (215.32037103013374 - 191.82813770055415) / 215.32037103013374 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 196.41314217518692 < 257.7510632726187. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.734487636646277 (T) = (0 -196.69303519651032) / Math.Sqrt((919.9699022185085 / (299)) + (52.0612506435537 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10687661919804618 = (220.23052964966118 - 196.69303519651032) / 220.23052964966118 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.194313713910761 < 12.897889432790082. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.088735158910202 (T) = (0 -8306.455515457319) / Math.Sqrt((4389247.4192234175 / (299)) + (198872.85990660285 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15272096752116077 = (9803.683552932454 - 8306.455515457319) / 9803.683552932454 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.192156238288863 < 12.88774952075287. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.755908690490108 (T) = (0 -8194.643164759962) / Math.Sqrt((4726815.1234106785 / (299)) + (13040.50872269268 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1646855071323392 = (9810.248995713573 - 8194.643164759962) / 9810.248995713573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 192.60611895490038 < 258.55957771820346. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.344095979048534 (T) = (0 -197.25160057031414) / Math.Sqrt((941.6188554340608 / (299)) + (34.72542964700673 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10848009804848524 = (221.25316567643114 - 197.25160057031414) / 221.25316567643114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 188.81459821661792 < 260.79220635222873. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.951527889547865 (T) = (0 -194.77157161964047) / Math.Sqrt((926.3165469580506 / (299)) + (30.550118875066563 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11263244768240356 = (219.49368230891776 - 194.77157161964047) / 219.49368230891776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 436.40585639288304 < 636.1559368739279. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.51170152974389 (T) = (0 -445.39970128698553) / Math.Sqrt((9608.09584443992 / (299)) + (317.19915746512225 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10513786104366706 = (497.72996520609297 - 445.39970128698553) / 497.72996520609297 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 539.9029183016229 < 777.3005908772905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.543165271065261 (T) = (0 -552.6551493479798) / Math.Sqrt((13466.206075430664 / (299)) + (148.12553114101243 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09653834647109284 = (611.7084739449841 - 552.6551493479798) / 611.7084739449841 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 127.96928113690899 < 162.3241038970605. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.494162687695994 (T) = (0 -128.3425563269911) / Math.Sqrt((281.95135502757176 / (299)) + (3.977872942020962 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09579456381836217 = (141.9395982277743 - 128.3425563269911) / 141.9395982277743 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 189.1138126288749 < 253.4376263595113. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.086472846113764 (T) = (0 -194.63599251412342) / Math.Sqrt((873.3423968119436 / (299)) + (48.55145432815244 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11571487315288878 = (220.10546893182686 - 194.63599251412342) / 220.10546893182686 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.218986133807766 < 12.887829360292516. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.54155671958489 (T) = (0 -8241.10974063723) / Math.Sqrt((4564760.076413218 / (299)) + (166878.98831870133 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15928162821920003 = (9802.461819861277 - 8241.10974063723) / 9802.461819861277 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 300.636501500156 < 405.0354204260478. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.611007472789735 (T) = (0 -289.6348365346956) / Math.Sqrt((3458.8216164990154 / (299)) + (50.586890506604675 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10489353480340491 = (323.5758513609687 - 289.6348365346956) / 323.5758513609687 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 200.19326984864853 < 248.03014867637555. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.14557333717434 (T) = (0 -190.95017244401177) / Math.Sqrt((878.8463796990419 / (299)) + (36.92959224829794 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10783080735545515 = (214.02910346859457 - 190.95017244401177) / 214.02910346859457 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.556145074600565 < 12.704662003793784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.701638910205306 (T) = (0 -8462.329582050157) / Math.Sqrt((4887248.436280747 / (299)) + (10893.874427985736 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11680938291517655 = (9581.543800795856 - 8462.329582050157) / 9581.543800795856 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0252981988193337 < 1.638993872157317. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.358241081203547 (T) = (0 -1011.8670692040686) / Math.Sqrt((82410.89989832239 / (299)) + (288.65251560824726 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14641613338497775 = (1185.4336858740492 - 1011.8670692040686) / 1185.4336858740492 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3605767056898284 < 4.703270025431681. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.952387359599651 (T) = (0 -3367.9956632266803) / Math.Sqrt((405829.12649391947 / (299)) + (2811.062707889947 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11752930575852726 = (3816.5524194790846 - 3367.9956632266803) / 3816.5524194790846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 184.32738733420803 < 248.00666398133293. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.761592449280627 (T) = (0 -191.5967819075578) / Math.Sqrt((904.2160128537703 / (299)) + (43.25932848109789 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10701014326888701 = (214.55650415663038 - 191.5967819075578) / 214.55650415663038 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreCase, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.378324032415438 < 4.653568539665984. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.726489270903157 (T) = (0 -3388.6206615731853) / Math.Sqrt((391544.125743975 / (299)) + (11181.476681366497 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10950565095918814 = (3805.32528389788 - 3388.6206615731853) / 3805.32528389788 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreNonSpace, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.3576757868828007 < 4.707044700717905. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.30327883071789 (T) = (0 -3393.4478850235196) / Math.Sqrt((396827.9812602277 / (299)) + (24661.796624197574 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11320051306228093 = (3826.6236449253215 - 3393.4478850235196) / 3826.6236449253215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.Tests.Add_Remove_SteadyState<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).Stack(Count%3a%20512).html>) 76.54 ns 59.83 ns 0.78 0.19 False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentBag(Count%3a%20512).html>) 371.21 ns 290.18 ns 0.78 0.14 False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentQueue(Count%3a%20512).html>) 230.98 ns 190.70 ns 0.83 0.11 False
[ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ImmutableQueue(Count%3a%20512).html>) 404.66 ns 332.63 ns 0.82 0.02 False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).Queue(Count%3a%20512).html>) 122.80 ns 93.59 ns 0.76 0.13 False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Tests.Add_Remove_SteadyState(String).ConcurrentStack(Count%3a%20512).html>) 224.64 ns 204.74 ns 0.91 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Add_Remove_SteadyState<String>.Stack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.83271517189662 < 72.73172296248141. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.196937674792787 (T) = (0 -59.32883047060705) / Math.Sqrt((54.68295227442894 / (299)) + (1.995587052064399 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08107050215525856 = (64.56298400449325 - 59.32883047060705) / 64.56298400449325 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentBag(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 290.17693974396786 < 352.42237003038343. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.101468582013613 (T) = (0 -295.91904664476334) / Math.Sqrt((688.1032515570014 / (299)) + (64.68523632269054 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09728405526287563 = (327.8097040048811 - 295.91904664476334) / 327.8097040048811 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentQueue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 190.69658765377562 < 219.811636248384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.2037899219738 (T) = (0 -187.3992687158242) / Math.Sqrt((249.89391186473924 / (299)) + (10.784739985572884 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09855419193152197 = (207.88744818433776 - 187.3992687158242) / 207.88744818433776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ImmutableQueue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 332.6332525011773 < 366.25271980767184. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.205092187621386 (T) = (0 -331.82771033634816) / Math.Sqrt((228.16954453316802 / (299)) + (25.499176293597806 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07451878777024798 = (358.54613356966934 - 331.82771033634816) / 358.54613356966934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.Queue(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.58712120131362 < 117.66383153203952. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.487219595841736 (T) = (0 -94.9986426176411) / Math.Sqrt((88.0885825779211 / (299)) + (2.074024167123289 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12463531839195176 = (108.52464648576891 - 94.9986426176411) / 108.52464648576891 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentStack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 204.73736051038745 < 216.17922169909392. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.14363227290442 (T) = (0 -197.12057216320096) / Math.Sqrt((119.98736835424171 / (299)) + (16.491061923409408 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0602224949551216 = (209.75238405369961 - 197.12057216320096) / 209.75238405369961 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetNow - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTime.GetNow.html>) 3.16 μs 2.48 μs 0.78 0.10 False
[ParseR - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTime.ParseR.html>) 888.34 ns 623.22 ns 0.70 0.09 False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTime.ToString(format%3a%20%22r%22).html>) 804.14 ns 595.72 ns 0.74 0.04 False
[ParseO - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTime.ParseO.html>) 925.99 ns 661.13 ns 0.71 0.10 False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_DateTime.ToString(format%3a%20%22o%22).html>) 1.08 μs 809.51 ns 0.75 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTime.GetNow ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4776614941605057 < 2.996058501472089. IsChangePoint: Marked as a change because one of 5/20/2022 10:18:01 PM, 5/21/2022 3:14:39 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 3.6336430237227604 (T) = (0 -2466.676598212252) / Math.Sqrt((166218.4841013961 / (299)) + (48261.753901068965 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05255122093075325 = (2603.4933525751776 - 2466.676598212252) / 2603.4933525751776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTime.ParseR ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 623.2182678431295 < 835.767694425773. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.03198549565931 (T) = (0 -612.948214569282) / Math.Sqrt((12109.328923451427 / (299)) + (112.12134629965422 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11345344201581944 = (691.3886349781749 - 612.948214569282) / 691.3886349781749 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTime.ToString(format: "r") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 595.7191493683495 < 759.75156597293. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.53047945347398 (T) = (0 -605.7961773171108) / Math.Sqrt((6834.64584437294 / (299)) + (91.68755787653951 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0651896177839944 = (648.0417727935869 - 605.7961773171108) / 648.0417727935869 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTime.ParseO ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 661.1303159126846 < 878.2989223976532. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.841146431316199 (T) = (0 -659.1840593674616) / Math.Sqrt((11036.17862723153 / (299)) + (244.79883358792296 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11123987035780317 = (741.6895035928766 - 659.1840593674616) / 741.6895035928766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_DateTime.ToString(format: "o") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 809.5107608657182 < 1.023188035252746. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.418460803456869 (T) = (0 -821.0738822327648) / Math.Sqrt((13389.63983120598 / (299)) + (116.68633439270728 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08692715684037809 = (899.2424737893842 - 821.0738822327648) / 899.2424737893842 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Char

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Char_ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToLower(c%3a%20%27a%27%2c%20cultureName%3a%20en-US).html>) 76.57 ns 57.66 ns 0.75 0.13 False
[GetUnicodeCategory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.GetUnicodeCategory(c%3a%20%27%d7%90%27).html>) 136.31 ns 94.75 ns 0.70 0.20 False
[Char_ToUpper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToUpper(c%3a%20%27a%27%2c%20cultureName%3a%20en-US).html>) 83.39 ns 61.29 ns 0.74 0.15 False
[Char_ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToLower(c%3a%20%27%c4%b0%27%2c%20cultureName%3a%20en-US).html>) 248.76 ns 213.97 ns 0.86 0.08 False
[Char_ToUpper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToUpper(c%3a%20%27%e4%bd%a0%27%2c%20cultureName%3a%20zh-Hans).html>) 272.18 ns 226.78 ns 0.83 0.10 False
[Char_ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToLower(c%3a%20%27A%27%2c%20cultureName%3a%20en-US).html>) 82.99 ns 61.56 ns 0.74 0.15 False
[Char_ToUpper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToUpper(c%3a%20%27%c4%b0%27%2c%20cultureName%3a%20en-US).html>) 248.46 ns 210.28 ns 0.85 0.12 False
[GetUnicodeCategory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.GetUnicodeCategory(c%3a%20%27.%27).html>) 44.65 ns 29.51 ns 0.66 0.21 False
[Char_ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToLower(c%3a%20%27%e4%bd%a0%27%2c%20cultureName%3a%20zh-Hans).html>) 273.23 ns 233.55 ns 0.85 0.09 False
[Char_ToLowerInvariant - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToLowerInvariant(input%3a%20%22Hello%20World!%22).html>) 628.87 ns 519.60 ns 0.83 0.06 False
[Char_IsUpper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_IsUpper(input%3a%20%22Good%20afternoon%2c%20Constable!%22).html>) 1.60 μs 1.03 μs 0.65 0.16 False
[Char_ToUpper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_ToUpper(c%3a%20%27A%27%2c%20cultureName%3a%20en-US).html>) 76.59 ns 56.53 ns 0.74 0.13 False
[GetUnicodeCategory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.GetUnicodeCategory(c%3a%20%27a%27).html>) 44.73 ns 29.52 ns 0.66 0.18 False
[Char_IsLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Char.Char_IsLower(input%3a%20%22Good%20afternoon%2c%20Constable!%22).html>) 1.63 μs 1.09 μs 0.67 0.15 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Char*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Char.Char_ToLower(c: 'a', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.66244423314647 < 73.14507353308191. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.416551112478185 (T) = (0 -57.44904159857008) / Math.Sqrt((80.74294590608454 / (299)) + (1.520165505731184 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05743878088277988 = (60.94993135021559 - 57.44904159857008) / 60.94993135021559 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.GetUnicodeCategory(c: 'א') ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.7454520618418 < 130.79007851449109. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.396922686565224 (T) = (0 -94.80504598614775) / Math.Sqrt((303.75492029722284 / (299)) + (10.049395969090652 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12523215025591142 = (108.37737808251956 - 94.80504598614775) / 108.37737808251956 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToUpper(c: 'a', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.29416408556832 < 79.44896335949862. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.674695176801164 (T) = (0 -60.501767966822726) / Math.Sqrt((120.17372547870298 / (299)) + (2.4090002550406786 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0685447900362369 = (64.95402819119607 - 60.501767966822726) / 64.95402819119607 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToLower(c: 'İ', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 213.97441803606532 < 236.43238537255314. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.351621545085143 (T) = (0 -214.21589174194324) / Math.Sqrt((184.39458140528293 / (299)) + (14.843043105470786 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06305119058359164 = (228.63137194802627 - 214.21589174194324) / 228.63137194802627 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToUpper(c: '你', cultureName: zh-Hans) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.78025731309953 < 259.19762834242186. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.122377089948786 (T) = (0 -231.21769361080288) / Math.Sqrt((267.12677432871715 / (299)) + (23.73310477520491 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07001159625796086 = (248.62427604520778 - 231.21769361080288) / 248.62427604520778 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToLower(c: 'A', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.5564213110516 < 79.71790993319799. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.590469366393287 (T) = (0 -60.46874434201243) / Math.Sqrt((119.77457866857013 / (299)) + (1.3855128128196876 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06636271240821795 = (64.76684805293618 - 60.46874434201243) / 64.76684805293618 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToUpper(c: 'İ', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 210.275130165198 < 237.17763941715305. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.399259703099762 (T) = (0 -213.34938535454225) / Math.Sqrt((175.0640148268481 / (299)) + (16.186544510153798 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06724965257778459 = (228.73149921001132 - 213.34938535454225) / 228.73149921001132 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.GetUnicodeCategory(c: '.') ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.513413897505156 < 42.48214466212102. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.305555335246684 (T) = (0 -30.204498323090075) / Math.Sqrt((45.717161914242105 / (299)) + (1.4466336381534068 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12620626067414284 = (34.56708026586826 - 30.204498323090075) / 34.56708026586826 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToLower(c: '你', cultureName: zh-Hans) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 233.54892570507397 < 258.9918016818057. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.496428679674505 (T) = (0 -229.71528955429196) / Math.Sqrt((255.54137488258033 / (299)) + (13.37005306843196 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07390374242278268 = (248.04688246474038 - 229.71528955429196) / 248.04688246474038 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToLowerInvariant(input: "Hello World!") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 519.6000631104122 < 599.3926054033528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.582557165241981 (T) = (0 -473.84036841321023) / Math.Sqrt((5778.888265639704 / (299)) + (88.1567155657356 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.051110112470194966 = (499.36286037016777 - 473.84036841321023) / 499.36286037016777 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_IsUpper(input: "Good afternoon, Constable!") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0325884354595078 < 1.4898670186531238. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.377803794097016 (T) = (0 -1049.6395414587098) / Math.Sqrt((41586.195372297145 / (299)) + (1026.554479504145 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12888510490795924 = (1204.9381170870765 - 1049.6395414587098) / 1204.9381170870765 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_ToUpper(c: 'A', cultureName: en-US) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.53306632157303 < 72.74530889539867. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.790562689419793 (T) = (0 -57.5101969106254) / Math.Sqrt((81.4506166823212 / (299)) + (1.3115488774685196 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.060387047677068574 = (61.206262396072184 - 57.5101969106254) / 61.206262396072184 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.GetUnicodeCategory(c: 'a') ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.522837244229642 < 42.42179657885807. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.911337310651227 (T) = (0 -29.809853088207735) / Math.Sqrt((36.028486380854005 / (299)) + (0.19296556176635885 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1323673172124612 = (34.35768808573963 - 29.809853088207735) / 34.35768808573963 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Char.Char_IsLower(input: "Good afternoon, Constable!") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.090354059359693 < 1.5582907328163398. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.94914666841972 (T) = (0 -1104.3125661621875) / Math.Sqrt((43315.375829630415 / (299)) + (1034.8895883643643 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12149184295092497 = (1257.0316590702967 - 1104.3125661621875) / 1257.0316590702967 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Globalization.Tests.Perf_CultureInfo

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetCurrentCulture - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.Perf_CultureInfo.GetCurrentCulture.html>) 22.40 ns 16.72 ns 0.75 0.59 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.Perf_CultureInfo*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.Perf_CultureInfo.GetCurrentCulture ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.71631169390505 < 20.62777448940296. IsChangePoint: Marked as a change because one of 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.631366555200923 (T) = (0 -17.36587338548278) / Math.Sqrt((4.145108141228867 / (299)) + (1.4149947062484134 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15927442331638555 = (20.6558166744319 - 17.36587338548278) / 20.6558166744319 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in Benchstone.BenchI.Fib

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchI.Fib.Test.html>) 978.94 μs 826.92 μs 0.84 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.Fib*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchI.Fib.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 826.9159929149798 < 922.0146126055616. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 51.419920510833414 (T) = (0 -816780.9942003798) / Math.Sqrt((405183964.9759362 / (299)) + (422096652.5928653 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15907984331150443 = (971294.3466795057 - 816780.9942003798) / 971294.3466795057 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(string)).html>) 4.07 μs 3.72 μs 0.91 0.01 False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.ClassIDerived)).html>) 4.04 μs 3.82 μs 0.95 0.02 False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.DerivedClass)).html>) 6.94 μs 6.52 μs 0.94 0.01 False
[GetConverter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert%3a%20typeof(System.ComponentModel.Tests.IDerived)).html>) 2.30 μs 2.01 μs 0.87 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.7159676808080793 < 3.859863679125757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.28791175695802 (T) = (0 -3759.9642964282207) / Math.Sqrt((6683.758744031217 / (299)) + (2567.8274577191514 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05292590012441727 = (3970.0845973109895 - 3759.9642964282207) / 3970.0845973109895 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassIDerived)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.823420654572199 < 3.8390604257341554. IsChangePoint: Marked as a change because one of 5/25/2022 10:02:21 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.12469462490845 (T) = (0 -3772.3397271687913) / Math.Sqrt((5799.094607362216 / (299)) + (2751.2034828796436 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.050276858108666264 = (3972.04149375189 - 3772.3397271687913) / 3972.04149375189 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.DerivedClass)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.517094305350612 < 6.536816538271092. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 39.0276802159883 (T) = (0 -6504.722072135643) / Math.Sqrt((7694.60392576908 / (299)) + (4491.677421737277 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.058539741621397974 = (6909.1839132309 - 6504.722072135643) / 6909.1839132309 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.IDerived)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.008446687640005 < 2.172271005370707. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.29229191365274 (T) = (0 -2015.6080404297213) / Math.Sqrt((5082.62211763619 / (299)) + (1196.6495610265547 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07510746695561092 = (2179.2889102424883 - 2015.6080404297213) / 2179.2889102424883 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_HashCode

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Add - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Add.html>) 91.99 μs 68.18 μs 0.74 0.04 False
[Combine_2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_2.html>) 1.65 ms 1.23 ms 0.75 0.05 False
[Combine_4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_4.html>) 3.51 ms 2.48 ms 0.70 0.03 False
[Combine_3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_3.html>) 2.24 ms 1.69 ms 0.76 0.04 False
[Combine_5 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_5.html>) 4.15 ms 2.98 ms 0.72 0.04 False
[Combine_6 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_6.html>) 4.70 ms 3.44 ms 0.73 0.01 False
[Combine_7 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_7.html>) 5.32 ms 3.88 ms 0.73 0.03 False
[Combine_1 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_1.html>) 941.44 μs 686.98 μs 0.73 0.05 False
[Combine_8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_HashCode.Combine_8.html>) 5.91 ms 4.42 ms 0.75 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_HashCode*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_HashCode.Add ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.18065697004609 < 85.80742169117987. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.38457743195994 (T) = (0 -69103.70282185361) / Math.Sqrt((64485783.53523878 / (299)) + (985960.8719779534 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09708819750119771 = (76534.27791131934 - 69103.70282185361) / 76534.27791131934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2287172015532544 < 1.5571893963556545. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.348621322103998 (T) = (0 -1214922.8162426935) / Math.Sqrt((24538867514.27924 / (299)) + (580607264.184644 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10197098263510371 = (1352877.014829281 - 1214922.8162426935) / 1352877.014829281 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.4772109107142852 < 3.367606653623511. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.99942339560638 (T) = (0 -2527564.8652869905) / Math.Sqrt((153895723215.21304 / (299)) + (1033955478.5560956 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10617925372522571 = (2827820.763638863 - 2527564.8652869905) / 2827820.763638863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.6949385285714287 < 2.1333146788690476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.697416692114782 (T) = (0 -1656898.3463014863) / Math.Sqrt((48490472334.43955 / (299)) + (353857605.3489212 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1032856491925022 = (1847743.7601053638 - 1656898.3463014863) / 1847743.7601053638 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_5 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.982315912202381 < 3.940961078989955. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.095910940062268 (T) = (0 -3013114.786498452) / Math.Sqrt((195922797785.4972 / (299)) + (2810708256.3859715 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09635100066078603 = (3334386.2370254025 - 3013114.786498452) / 3334386.2370254025 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_6 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.436322080833333 < 4.481354585574777. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.985749885568701 (T) = (0 -3442925.0989307365) / Math.Sqrt((238440684432.27768 / (299)) + (1489593449.5496838 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09772086277107053 = (3815809.2732861065 - 3442925.0989307365) / 3815809.2732861065 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_7 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.8800858880208335 < 5.051821934151786. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.134206216864468 (T) = (0 -3899224.14330864) / Math.Sqrt((298611470707.2438 / (299)) + (1806457148.3937013 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09762414375340167 = (4321064.350643567 - 3899224.14330864) / 4321064.350643567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_1 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 686.9828663043478 < 881.0836881466817. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.32421843000931 (T) = (0 -686895.1170860934) / Math.Sqrt((8711850919.447369 / (299)) + (194510333.30344748 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09981147375778515 = (763056.9564727708 - 686895.1170860934) / 763056.9564727708 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_HashCode.Combine_8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.4191864177083335 < 5.626223618388087. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.916691969394352 (T) = (0 -4405544.709307392) / Math.Sqrt((328032888674.73364 / (299)) + (3452972614.864315 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09709063508717078 = (4879276.791788202 - 4405544.709307392) / 4879276.791788202 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Memory.Constructors<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ArrayAsSpanStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ArrayAsSpanStartLength.html>) 40.49 ns 26.72 ns 0.66 0.22 False
[ReadOnlySpanFromMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ReadOnlySpanFromMemory.html>) 44.49 ns 26.80 ns 0.60 0.17 False
[SpanFromArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).SpanFromArray.html>) 24.83 ns 17.48 ns 0.70 0.22 False
[ReadOnlyMemoryFromArrayStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ReadOnlyMemoryFromArrayStartLength.html>) 29.20 ns 18.85 ns 0.65 0.27 False
[ArrayAsMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ArrayAsMemory.html>) 27.01 ns 20.46 ns 0.76 0.24 False
[SpanImplicitCastFromArraySegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).SpanImplicitCastFromArraySegment.html>) 58.42 ns 39.19 ns 0.67 0.19 False
[ArrayAsMemoryStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ArrayAsMemoryStartLength.html>) 35.13 ns 23.35 ns 0.66 0.26 False
[ReadOnlySpanFromArrayStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ReadOnlySpanFromArrayStartLength.html>) 33.08 ns 21.62 ns 0.65 0.21 False
[ReadOnlySpanImplicitCastFromArraySegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ReadOnlySpanImplicitCastFromArraySegment.html>) 50.59 ns 34.97 ns 0.69 0.20 False
[ArrayAsSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).ArrayAsSpan.html>) 25.09 ns 18.42 ns 0.73 0.21 False
[SpanFromMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).SpanFromMemory.html>) 42.63 ns 26.93 ns 0.63 0.18 False
[MemoryFromArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).MemoryFromArray.html>) 27.29 ns 18.94 ns 0.69 0.19 False
[SpanFromArrayStartLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Memory.Constructors(String).SpanFromArrayStartLength.html>) 40.20 ns 25.48 ns 0.63 0.21 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Constructors&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Constructors<String>.ArrayAsSpanStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.7212695934673 < 38.4660242663197. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.71101346866977 (T) = (0 -25.78500857528725) / Math.Sqrt((46.25223132342913 / (299)) + (0.3850191794960874 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09477486204089222 = (28.484636024825075 - 25.78500857528725) / 28.484636024825075 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ReadOnlySpanFromMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.800938445330832 < 40.87943002942979. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.137185628643176 (T) = (0 -27.240696559428812) / Math.Sqrt((57.25876194353392 / (299)) + (0.8461860385515386 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07895254528456708 = (29.575779640849348 - 27.240696559428812) / 29.575779640849348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.SpanFromArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.478647668948742 < 23.677041313548205. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.512710995413706 (T) = (0 -17.38927867731725) / Math.Sqrt((13.084941749820755 / (299)) + (0.39784165553840833 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06680707169357689 = (18.63417322383235 - 17.38927867731725) / 18.63417322383235 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ReadOnlyMemoryFromArrayStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.854440702723878 < 27.74940559422115. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.3851058030198935 (T) = (0 -19.865188748940415) / Math.Sqrt((20.27292012156547 / (299)) + (0.8699716754608143 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07257714459896024 = (21.419774845154354 - 19.865188748940415) / 21.419774845154354 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ArrayAsMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.458755853603638 < 25.694608702884974. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.668789512437588 (T) = (0 -19.223248511273443) / Math.Sqrt((12.669671706156992 / (299)) + (0.8042254681567144 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07648649741909988 = (20.815341040007674 - 19.223248511273443) / 20.815341040007674 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.SpanImplicitCastFromArraySegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 39.19130607377024 < 55.723064739223126. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.980369838445609 (T) = (0 -39.879695004610426) / Math.Sqrt((80.18116887807031 / (299)) + (2.8806072832293834 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09016344716521466 = (43.83171337792148 - 39.879695004610426) / 43.83171337792148 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ArrayAsMemoryStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.351818925465576 < 34.58743445915228. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.923001162080617 (T) = (0 -24.033926367622847) / Math.Sqrt((29.417731551146233 / (299)) + (0.6788046542334227 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1098606603614963 = (27.000184462562135 - 24.033926367622847) / 27.000184462562135 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ReadOnlySpanFromArrayStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.61812526864145 < 31.910984418741858. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.799556583888233 (T) = (0 -21.854334833160113) / Math.Sqrt((33.69514036147283 / (299)) + (0.8259252270816231 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.072700731223801 = (23.567725726778928 - 21.854334833160113) / 23.567725726778928 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ReadOnlySpanImplicitCastFromArraySegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.968465909900466 < 48.920705872075445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.803718532464189 (T) = (0 -35.74526801187767) / Math.Sqrt((69.88349340681492 / (299)) + (2.857063587758761 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07985073087861547 = (38.847249257731264 - 35.74526801187767) / 38.847249257731264 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.ArrayAsSpan ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.42417846913976 < 23.6621196648829. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.219578338795756 (T) = (0 -17.554949577052824) / Math.Sqrt((12.855980576768523 / (299)) + (0.9674978448123643 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05585955174315662 = (18.59357853957464 - 17.554949577052824) / 18.59357853957464 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.SpanFromMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.93464282565017 < 40.725808705303024. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.016230402462742 (T) = (0 -27.493807692307687) / Math.Sqrt((56.47501954255774 / (299)) + (5.372838062098839 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07232172808315164 = (29.63722286552818 - 27.493807692307687) / 29.63722286552818 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.MemoryFromArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.93631239082817 < 25.72750424853036. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.4349717057534415 (T) = (0 -19.40799955127744) / Math.Sqrt((12.997627381294343 / (299)) + (0.762413353235261 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06283919886031424 = (20.709359085095407 - 19.40799955127744) / 20.709359085095407 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Constructors<String>.SpanFromArrayStartLength ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.479902165372668 < 38.382875912858175. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.871692170868255 (T) = (0 -25.9789463659229) / Math.Sqrt((46.7887538564292 / (299)) + (1.2259660926818436 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08713945758761307 = (28.458833697937237 - 25.9789463659229) / 28.458833697937237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IterateTryGetSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateTryGetSingleSegment.html>) 353.57 ns 275.04 ns 0.78 0.14 False
[SliceMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).SliceMemory.html>) 157.22 ns 105.33 ns 0.67 0.11 False
[FirstSpanMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstSpanMemory.html>) 117.02 ns 78.87 ns 0.67 0.13 False
[IterateGetPositionArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateGetPositionArray.html>) 911.00 ns 641.54 ns 0.70 0.12 False
[IterateForEachArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateForEachArray.html>) 385.07 ns 321.51 ns 0.83 0.08 False
[IterateGetPositionTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateGetPositionTenSegments.html>) 1.39 μs 938.41 ns 0.67 0.10 False
[IterateGetPositionSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateGetPositionSingleSegment.html>) 946.48 ns 685.21 ns 0.72 0.15 False
[SliceTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).SliceTenSegments.html>) 386.08 ns 251.62 ns 0.65 0.06 False
[FirstSpanArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstSpanArray.html>) 106.16 ns 71.61 ns 0.67 0.13 False
[IterateForEachMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateForEachMemory.html>) 548.71 ns 451.97 ns 0.82 0.08 False
[FirstSpanSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstSpanSingleSegment.html>) 127.74 ns 79.59 ns 0.62 0.12 False
[IterateTryGetArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateTryGetArray.html>) 317.62 ns 252.23 ns 0.79 0.09 False
[SliceArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).SliceArray.html>) 140.23 ns 93.27 ns 0.67 0.07 False
[IterateTryGetMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateTryGetMemory.html>) 490.56 ns 389.89 ns 0.79 0.11 False
[IterateForEachTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateForEachTenSegments.html>) 2.84 μs 2.34 μs 0.82 0.03 False
[IterateGetPositionMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateGetPositionMemory.html>) 1.09 μs 762.95 ns 0.70 0.06 False
[FirstSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstSingleSegment.html>) 77.93 ns 49.08 ns 0.63 0.06 False
[FirstSpanTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstSpanTenSegments.html>) 121.89 ns 76.89 ns 0.63 0.12 False
[FirstArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstArray.html>) 90.05 ns 60.96 ns 0.68 0.14 False
[FirstTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstTenSegments.html>) 72.04 ns 47.00 ns 0.65 0.08 False
[SliceSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).SliceSingleSegment.html>) 143.66 ns 95.19 ns 0.66 0.14 False
[FirstMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).FirstMemory.html>) 111.10 ns 69.34 ns 0.62 0.13 False
[IterateForEachSingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateForEachSingleSegment.html>) 416.76 ns 356.32 ns 0.85 0.09 False
[IterateTryGetTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Tests.ReadOnlySequenceTests(Char).IterateTryGetTenSegments.html>) 2.59 μs 2.16 μs 0.83 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 275.0415135980303 < 335.9150500622646. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.996781545215034 (T) = (0 -277.2267437160535) / Math.Sqrt((935.1427839937006 / (299)) + (53.06290273287879 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08033919710309488 = (301.4445574311716 - 277.2267437160535) / 301.4445574311716 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.32845230618939 < 150.0677698593147. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.806150007384074 (T) = (0 -107.82737613671635) / Math.Sqrt((370.84713841388566 / (299)) + (8.236312218644398 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1310492704737275 = (124.08917154083156 - 107.82737613671635) / 124.08917154083156 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 78.8748409842083 < 110.51013304131104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.551299084067224 (T) = (0 -81.16015848068632) / Math.Sqrt((225.13921296601245 / (299)) + (4.471418969684449 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10605902998423632 = (90.78916975832884 - 81.16015848068632) / 90.78916975832884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 641.5448705276008 < 867.531418071368. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.498491016120264 (T) = (0 -650.640622972497) / Math.Sqrt((10498.464422674177 / (299)) + (527.2175979890436 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11381125312987007 = (734.2009535445475 - 650.640622972497) / 734.2009535445475 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 321.5100636648927 < 360.7854622883649. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.936265488969568 (T) = (0 -322.45701292758423) / Math.Sqrt((468.2855688202547 / (299)) + (39.560639417184056 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06933771654722116 = (346.4812302603058 - 322.45701292758423) / 346.4812302603058 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 938.4126272770706 < 1.3240751697900197. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.460865373699773 (T) = (0 -967.0447162030874) / Math.Sqrt((27676.37182038365 / (299)) + (858.1453958474635 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11804148110194151 = (1096.4741487063789 - 967.0447162030874) / 1096.4741487063789 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 685.210178887788 < 905.8678832986369. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.694621748200001 (T) = (0 -674.9221522816354) / Math.Sqrt((12159.543156782625 / (299)) + (213.18519456846425 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.111455058096856 = (759.5813339908758 - 674.9221522816354) / 759.5813339908758 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 251.62128314787134 < 364.48644280570244. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.395751101822558 (T) = (0 -259.2105657403607) / Math.Sqrt((2679.529343915967 / (299)) + (26.418473799050872 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10971445731861747 = (291.15441430135365 - 259.2105657403607) / 291.15441430135365 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.61126584379149 < 101.7530195664187. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.057866761832242 (T) = (0 -72.22337384850196) / Math.Sqrt((226.37778861125463 / (299)) + (2.0674806166857556 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10055970478409625 = (80.29813010675188 - 72.22337384850196) / 80.29813010675188 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 451.9744775166153 < 521.8230175952134. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.43758870713025 (T) = (0 -454.1994094071191) / Math.Sqrt((615.3545807083475 / (299)) + (107.69006158268849 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11148356695797546 = (511.1885301345199 - 454.1994094071191) / 511.1885301345199 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.58565994025145 < 121.52837924669204. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.147668791444417 (T) = (0 -80.75150137928604) / Math.Sqrt((430.2084209843845 / (299)) + (13.693367873375074 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11589067969761463 = (91.33655705797469 - 80.75150137928604) / 91.33655705797469 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 252.23439825703608 < 300.3677593802018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.612036466013752 (T) = (0 -254.95244437745083) / Math.Sqrt((658.9837592703466 / (299)) + (34.12476920481971 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07097219803476831 = (274.42929462189795 - 254.95244437745083) / 274.42929462189795 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.26708755411916 < 134.19674616300045. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.319580190977666 (T) = (0 -94.55217791396814) / Math.Sqrt((367.5860293313993 / (299)) + (2.159521482382348 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.118851099416726 = (107.30556192191762 - 94.55217791396814) / 107.30556192191762 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 389.89243459136327 < 469.9626572524966. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.823832895292313 (T) = (0 -393.272306945253) / Math.Sqrt((876.672571859792 / (299)) + (68.97196213469071 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11815619636076412 = (445.9659469423924 - 393.272306945253) / 445.9659469423924 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3359127405088507 < 2.6831760068846777. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.302476200668352 (T) = (0 -2363.7873071123845) / Math.Sqrt((33543.61695119927 / (299)) + (1126.9357334442445 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06079667450613605 = (2516.8004019464342 - 2363.7873071123845) / 2516.8004019464342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 762.9546381086374 < 1.0169324678669316. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.896822495856455 (T) = (0 -771.3324972654376) / Math.Sqrt((10164.283813841705 / (299)) + (242.71899254278003 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1377075495513047 = (894.5138008155742 - 771.3324972654376) / 894.5138008155742 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.077972645341895 < 73.97452493553006. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.545106220863163 (T) = (0 -49.8448556967376) / Math.Sqrt((146.0611611147304 / (299)) + (2.9591011426395735 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11209441964533162 = (56.13756327201749 - 49.8448556967376) / 56.13756327201749 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.88717104935444 < 116.727184608273. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.744596025476728 (T) = (0 -78.51106351975311) / Math.Sqrt((362.8167997904648 / (299)) + (9.909821761049786 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11608793478108247 = (88.8222557526787 - 78.51106351975311) / 88.8222557526787 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstArray ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.95692394937918 < 85.85197403759351. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.407229582333382 (T) = (0 -61.346804464387006) / Math.Sqrt((160.7872682314308 / (299)) + (0.7190856539056393 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09233928182719452 = (67.58781473751898 - 61.346804464387006) / 67.58781473751898 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.003472537266745 < 68.76425700145258. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.882387597862039 (T) = (0 -47.89171253408409) / Math.Sqrt((118.8256721011491 / (299)) + (0.38592046292306537 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10548914197222922 = (53.53955416446969 - 47.89171253408409) / 53.53955416446969 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 95.1932874684679 < 136.7998359485526. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.601490156066946 (T) = (0 -97.06751680954184) / Math.Sqrt((399.7179743910466 / (299)) + (10.247927180901662 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11866776042480075 = (110.13725863055711 - 97.06751680954184) / 110.13725863055711 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstMemory ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.34108691777568 < 96.31620159100187. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.79483164621232 (T) = (0 -70.4218499559597) / Math.Sqrt((165.7139588688022 / (299)) + (8.901035803822758 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09540520009238641 = (77.84905458571274 - 70.4218499559597) / 77.84905458571274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachSingleSegment ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 356.3166505886988 < 396.4768752784321. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.259619198156498 (T) = (0 -346.8566378257877) / Math.Sqrt((740.7259820974441 / (299)) + (55.31231382869965 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07108676003740155 = (373.4004672382035 - 346.8566378257877) / 373.4004672382035 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetTenSegments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.163912466491033 < 2.482224645586354. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.59202596975379 (T) = (0 -2161.276147291601) / Math.Sqrt((30158.844522320684 / (299)) + (1003.481796892343 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05970753489680962 = (2298.5147999185724 - 2161.276147291601) / 2298.5147999185724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.ContainsTrueComparer<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrueComparer(String).ImmutableHashSet(Size%3a%20512).html>) 317.19 μs 232.71 μs 0.73 0.03 False
[SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrueComparer(String).SortedSet(Size%3a%20512).html>) 1.66 ms 1.37 ms 0.82 0.09 False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrueComparer(String).HashSet(Size%3a%20512).html>) 183.17 μs 132.28 μs 0.72 0.10 False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrueComparer(String).ImmutableSortedSet(Size%3a%20512).html>) 1.70 ms 1.46 ms 0.86 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrueComparer&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsTrueComparer<String>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 232.7092108455882 < 301.0789522837922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.617334007444791 (T) = (0 -235735.76961838183) / Math.Sqrt((1003591186.1526883 / (299)) + (16192341.877888102 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08600284124121153 = (257917.39871326502 - 235735.76961838183) / 257917.39871326502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrueComparer<String>.SortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3710902767361108 < 1.5749430376212799. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.278690605452855 (T) = (0 -1375799.5635282954) / Math.Sqrt((8270041558.3295555 / (299)) + (523525995.35615313 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08228810043795207 = (1499162.8246128843 - 1375799.5635282954) / 1499162.8246128843 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrueComparer<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 132.27520963846607 < 174.24904011887253. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.218201610601712 (T) = (0 -131022.33132391934) / Math.Sqrt((412899547.3839875 / (299)) + (6417353.837836239 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10982474654564249 = (147187.11940764743 - 131022.33132391934) / 147187.11940764743 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrueComparer<String>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4613760731060608 < 1.632271081196581. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.848689108704363 (T) = (0 -1461306.5418431908) / Math.Sqrt((8559486036.580226 / (299)) + (1034465481.881784 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08158849311711018 = (1591123.9470451535 - 1461306.5418431908) / 1591123.9470451535 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Environment

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SetEnvironmentVariable - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.SetEnvironmentVariable.html>) 1.42 μs 981.13 ns 0.69 0.02 False
[GetEnvironmentVariable - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.GetEnvironmentVariable.html>) 916.15 ns 619.15 ns 0.68 0.07 False
[GetEnvironmentVariables - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.GetEnvironmentVariables.html>) 49.00 μs 37.42 μs 0.76 0.36 False
[ExpandEnvironmentVariables - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Environment.ExpandEnvironmentVariables.html>) 2.36 μs 1.78 μs 0.76 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Environment*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Environment.SetEnvironmentVariable ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 981.1268248071946 < 1.3453207503030493. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.942657776679308 (T) = (0 -983.9443004426045) / Math.Sqrt((30463.455826105426 / (299)) + (156.8670340270939 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11862044118829694 = (1116.3684142722593 - 983.9443004426045) / 1116.3684142722593 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.GetEnvironmentVariable ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 619.1504416292529 < 870.6340252983653. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.79156858408144 (T) = (0 -635.5913458688281) / Math.Sqrt((10441.73648705692 / (299)) + (85.73296838835861 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13044092450430506 = (730.9352104760762 - 635.5913458688281) / 730.9352104760762 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.GetEnvironmentVariables ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.417429474940334 < 46.76781238335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.256194350021895 (T) = (0 -36870.69010364438) / Math.Sqrt((26150612.459817763 / (299)) + (1531778.983523958 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07855195300526359 = (40013.8566942505 - 36870.69010364438) / 40013.8566942505 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Environment.ExpandEnvironmentVariables ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7817250833815306 < 2.239753878534774. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.140847338958718 (T) = (0 -1768.3578498529635) / Math.Sqrt((50527.78697183085 / (299)) + (554.3885663702168 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10879873556070624 = (1984.2407326088564 - 1768.3578498529635) / 1984.2407326088564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Globalization.Tests.StringHash

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringHash.GetHashCode(Count%3a%20128%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>) 1.24 μs 978.47 ns 0.79 0.05 False
[GetHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringHash.GetHashCode(Count%3a%20131072%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>) 502.17 μs 305.53 μs 0.61 0.07 False
[GetHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringHash.GetHashCode(Count%3a%20131072%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>) 1.14 ms 693.60 μs 0.61 0.06 False
[GetHashCode - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringHash.GetHashCode(Count%3a%20128%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>) 668.83 ns 415.44 ns 0.62 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringHash*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.StringHash.GetHashCode(Count: 128, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 978.4675264207635 < 1.1989826261054968. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.884910759385429 (T) = (0 -800.5321483011409) / Math.Sqrt((39902.76059345449 / (299)) + (620.1663684263216 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12925870146142268 = (919.3685307504386 - 800.5321483011409) / 919.3685307504386 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringHash.GetHashCode(Count: 131072, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 305.53468916316524 < 477.0993030634014. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.582715044135824 (T) = (0 -307236.007728663) / Math.Sqrt((6079015410.946453 / (299)) + (80910483.10116789 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14960551426639937 = (361286.4533847759 - 307236.007728663) / 361286.4533847759 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringHash.GetHashCode(Count: 131072, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 693.5983016304347 < 1.0850759287207696. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.467286810719797 (T) = (0 -696922.5994629681) / Math.Sqrt((31560816847.590527 / (299)) + (514930857.75318754 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1499400727489209 = (819851.1388681431 - 696922.5994629681) / 819851.1388681431 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringHash.GetHashCode(Count: 128, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 415.4407819757536 < 615.480791294754. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.373967409365 (T) = (0 -418.09247291478977) / Math.Sqrt((8655.183260712465 / (299)) + (264.3497877074032 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12599304558963165 = (478.36286748638935 - 418.09247291478977) / 478.36286748638935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in StoreBlock.AnyLocation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros16.html>) 11.90 ns 7.50 ns 0.63 0.06 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes32.html>) 12.70 ns 8.19 ns 0.64 0.06 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock32.html>) 18.01 ns 10.07 ns 0.56 0.06 False
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock8.html>) 14.50 ns 9.35 ns 0.65 0.11 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros128.html>) 12.76 ns 8.37 ns 0.66 0.15 False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes16.html>) 11.90 ns 8.16 ns 0.69 0.10 False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros8.html>) 11.59 ns 7.90 ns 0.68 0.08 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros64.html>) 12.08 ns 7.65 ns 0.63 0.10 False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes8.html>) 11.73 ns 7.73 ns 0.66 0.07 False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock16.html>) 14.67 ns 10.08 ns 0.69 0.07 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllOnes64.html>) 12.09 ns 8.30 ns 0.69 0.06 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.InitBlockAllZeros32.html>) 11.96 ns 7.56 ns 0.63 0.09 False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock128.html>) 18.01 ns 12.44 ns 0.69 0.08 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/StoreBlock.AnyLocation.CopyBlock64.html>) 14.99 ns 10.20 ns 0.68 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'StoreBlock.AnyLocation*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.AnyLocation.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.5034069953920355 < 11.295987822103276. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.339302157926967 (T) = (0 -7.723322939511981) / Math.Sqrt((3.406103922869509 / (299)) + (0.031584967924870304 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10559572290987684 = (8.635158772539896 - 7.723322939511981) / 8.635158772539896 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.189495811596686 < 11.421580608602838. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.2435463403448175 (T) = (0 -8.235381914296868) / Math.Sqrt((3.093321337027683 / (299)) + (0.013649714011044351 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07236960719099582 = (8.877869869441097 - 8.235381914296868) / 8.877869869441097 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.06559517997618 < 14.131347926262174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.091720736769032 (T) = (0 -10.16130068379083) / Math.Sqrt((4.53543184574553 / (299)) + (0.011468904714540406 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08986363957083936 = (11.164591511319719 - 10.16130068379083) / 11.164591511319719 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.354755745332666 < 13.770823098478532. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.1510058252428665 (T) = (0 -9.821603977873528) / Math.Sqrt((4.412001918249003 / (299)) + (0.11590626673807718 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08647265672899719 = (10.751297210990975 - 9.821603977873528) / 10.751297210990975 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.367928127446909 < 12.042303928408467. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.3668665923294085 (T) = (0 -8.63910626780245) / Math.Sqrt((3.3084948036213775 / (299)) + (0.054911446427504305 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08558082063337613 = (9.447643337693728 - 8.63910626780245) / 9.447643337693728 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.156612767508776 < 11.310310863230322. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.989998469479067 (T) = (0 -8.191472048312026) / Math.Sqrt((3.0987349868805545 / (299)) + (0.011258426302810438 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06991812228464825 = (8.80725906458205 - 8.191472048312026) / 8.80725906458205 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.896300118613907 < 11.019923022096215. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.64269374763829 (T) = (0 -7.96254221274638) / Math.Sqrt((2.925335244468344 / (299)) + (0.0019151968132276765 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06561234209889263 = (8.521668865610284 - 7.96254221274638) / 8.521668865610284 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.654170993429054 < 11.50084175175287. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.813510292461093 (T) = (0 -7.7812860854828845) / Math.Sqrt((3.5162966494089667 / (299)) + (0.06458475778639225 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12535120046424875 = (8.896469176671893 - 7.7812860854828845) / 8.896469176671893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.72560938880096 < 11.144122217394234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.634955850201796 (T) = (0 -8.01013959381807) / Math.Sqrt((3.3165220070051045 / (299)) + (0.05381442862261554 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.059731745674049874 = (8.518993975352595 - 8.01013959381807) / 8.518993975352595 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.08486766627134 < 13.964524793193286. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.616264225453363 (T) = (0 -10.059203984871118) / Math.Sqrt((4.552298560913211 / (299)) + (0.010769750023130579 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08593335343953742 = (11.004891188977142 - 10.059203984871118) / 11.004891188977142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.304369232467131 < 11.523672618849565. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.857443335982265 (T) = (0 -8.343834797973711) / Math.Sqrt((3.09844850793693 / (299)) + (0.005685055804326604 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07755182094343746 = (9.045315484830162 - 8.343834797973711) / 9.045315484830162 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.561748432491004 < 11.391969982311029. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.884875537524671 (T) = (0 -7.646552460899163) / Math.Sqrt((3.2482425925860126 / (299)) + (0.050542066110508974 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1229797781614468 = (8.718786945264739 - 7.646552460899163) / 8.718786945264739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.43543916760011 < 16.81299872734765. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.640633441690417 (T) = (0 -12.557027787000063) / Math.Sqrt((4.231245318946648 / (299)) + (0.09833265307424029 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11266000389849268 = (14.151314988807966 - 12.557027787000063) / 14.151314988807966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.195836260758357 < 14.23671653080636. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.978077660409488 (T) = (0 -10.339961504747643) / Math.Sqrt((4.355275962834452 / (299)) + (0.05177815229933657 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0876611676516328 = (11.333466403192006 - 10.339961504747643) / 11.333466403192006 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[InverseBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.InverseBenchmark.html>) 100.43 ns 65.82 ns 0.66 0.20 False
[ConjugateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark.html>) 66.73 ns 47.40 ns 0.71 0.23 False
[SlerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark.html>) 215.02 ns 139.70 ns 0.65 0.22 False
[CreateFromAxisAngleBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark.html>) 76.18 ns 68.46 ns 0.90 0.20 False
[CreateFromYawPitchRollBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark.html>) 102.30 ns 75.41 ns 0.74 0.12 False
[CreateFromVector3WithScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark.html>) 46.82 ns 37.79 ns 0.81 0.17 False
[MultiplyByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark.html>) 149.71 ns 101.24 ns 0.68 0.27 False
[LengthBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LengthBenchmark.html>) 81.20 ns 61.56 ns 0.76 0.12 False
[CreateFromRotationMatrixBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark.html>) 73.37 ns 43.47 ns 0.59 0.20 False
[MultiplyByScalarOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark.html>) 68.76 ns 50.82 ns 0.74 0.24 False
[ConcatenateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark.html>) 145.76 ns 117.68 ns 0.81 0.22 False
[NegationOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark.html>) 67.45 ns 50.57 ns 0.75 0.16 False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NegateBenchmark.html>) 74.80 ns 49.15 ns 0.66 0.20 False
[EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark.html>) 142.56 ns 117.07 ns 0.82 0.13 False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.SubtractBenchmark.html>) 109.51 ns 77.48 ns 0.71 0.26 False
[LengthSquaredBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark.html>) 66.73 ns 49.51 ns 0.74 0.18 False
[IsIdentityBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark.html>) 97.49 ns 76.60 ns 0.79 0.18 False
[MultiplyByScalarBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark.html>) 71.60 ns 50.75 ns 0.71 0.17 False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.AddBenchmark.html>) 109.24 ns 77.40 ns 0.71 0.24 False
[NormalizeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark.html>) 96.52 ns 67.71 ns 0.70 0.13 False
[LerpBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.LerpBenchmark.html>) 216.30 ns 136.45 ns 0.63 0.21 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.DivideBenchmark.html>) 109.68 ns 77.30 ns 0.70 0.31 False
[MultiplyByQuaternionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark.html>) 145.73 ns 116.60 ns 0.80 0.25 False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark.html>) 184.59 ns 136.33 ns 0.74 0.19 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_Quaternion.InverseBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 65.82234076440639 < 94.85122895877521. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.568997307247344 (T) = (0 -67.84795891597467) / Math.Sqrt((179.1773405150241 / (299)) + (7.029783092838495 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11708973229410569 = (76.84581479867381 - 67.84795891597467) / 76.84581479867381 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.40155954402845 < 62.72859050056281. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.691694879268715 (T) = (0 -48.80254563212468) / Math.Sqrt((52.836277845414465 / (299)) + (0.7696419979388436 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08726559538996988 = (53.468506704286874 - 48.80254563212468) / 53.468506704286874 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 139.69916417786627 < 204.4795080580393. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.989489253510028 (T) = (0 -141.85973943154704) / Math.Sqrt((1029.6220918492008 / (299)) + (32.65782063442783 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11294651346486004 = (159.92241909296342 - 141.85973943154704) / 159.92241909296342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.45778707970142 < 72.25884545953537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.9706357579725164 (T) = (0 -63.880454506032486) / Math.Sqrt((31.88730006691449 / (299)) + (11.46053615825272 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05738863199751786 = (67.76966274171252 - 63.880454506032486) / 67.76966274171252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.4104980167629 < 97.76345936300719. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.459928943859515 (T) = (0 -75.32409567517131) / Math.Sqrt((141.10012992335473 / (299)) + (9.921829118662362 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07389434230720965 = (81.33423551566075 - 75.32409567517131) / 81.33423551566075 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.78980116443084 < 44.43298557941545. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.82767092824162 (T) = (0 -38.20735593084588) / Math.Sqrt((11.343346016051756 / (299)) + (0.5576645691819099 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08791473501126666 = (41.890114222290215 - 38.20735593084588) / 41.890114222290215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.2366850226163 < 142.94815981670678. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.847400503399499 (T) = (0 -105.11539957368231) / Math.Sqrt((403.4210413647186 / (299)) + (46.96527109029927 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09944509841110011 = (116.7229220430884 - 105.11539957368231) / 116.7229220430884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LengthBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.56207915003917 < 76.21904675489841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.749728459836389 (T) = (0 -62.39036701246723) / Math.Sqrt((48.658539919648184 / (299)) + (3.9932748296746543 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08350122657031042 = (68.07468686400112 - 62.39036701246723) / 68.07468686400112 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.473405489167554 < 69.51201953227229. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.789369150799596 (T) = (0 -45.5975657605839) / Math.Sqrt((83.99379752107092 / (299)) + (19.908762579987844 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.21645286539274486 = (58.193775137011 - 45.5975657605839) / 58.193775137011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.81662566353674 < 66.08043680587608. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.01973153713096 (T) = (0 -50.04701765217283) / Math.Sqrt((59.25909757722378 / (299)) + (3.3753873445078506 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11702829288426238 = (56.68020532124797 - 50.04701765217283) / 56.68020532124797 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.67972991557893 < 139.58304072437463. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.791043690986376 (T) = (0 -116.01343385846484) / Math.Sqrt((195.2765192395101 / (299)) + (4.68409856624396 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0611285614766026 = (123.56690074726743 - 116.01343385846484) / 123.56690074726743 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.56925060775475 < 64.00258120877363. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.983976665701327 (T) = (0 -49.70451253958036) / Math.Sqrt((57.44401950339021 / (299)) + (2.6226097531046264 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08970497088263191 = (54.60264084686301 - 49.70451253958036) / 54.60264084686301 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.14568517856422 < 65.08570794791319. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.866413693542825 (T) = (0 -50.545462628836866) / Math.Sqrt((54.46798337219335 / (299)) + (10.616749754307959 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10635738798743409 = (56.561159852263316 - 50.545462628836866) / 56.561159852263316 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.07103330258539 < 128.43135757290685. IsChangePoint: Marked as a change because one of 4/29/2022 5:18:09 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.969771365286593 (T) = (0 -111.54259946985727) / Math.Sqrt((561.1435866931912 / (299)) + (5.687430759563955 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07003748973889992 = (119.94311409235208 - 111.54259946985727) / 119.94311409235208 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.47949956440057 < 103.94349705163063. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 3.9030868801683236 (T) = (0 -83.97369120315933) / Math.Sqrt((158.05189135947347 / (299)) + (67.53275217627565 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05768384831769472 = (89.11413759940562 - 83.97369120315933) / 89.11413759940562 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.51286834958641 < 63.639884201518626. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.942893282701954 (T) = (0 -50.669136586115656) / Math.Sqrt((39.9768818710797 / (299)) + (3.9323229789857046 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1034209436995113 = (56.51385254880846 - 50.669136586115656) / 56.51385254880846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.60362905415859 < 92.2856177561579. IsChangePoint: Marked as a change because one of 5/9/2022 10:19:44 PM, 5/17/2022 4:22:41 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.69371236457661 (T) = (0 -77.89054375149342) / Math.Sqrt((66.60958231291815 / (299)) + (9.301333114610781 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12407974213628248 = (88.92424059407043 - 77.89054375149342) / 88.92424059407043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.74740138054737 < 67.86346807052801. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.717832116824031 (T) = (0 -52.609412419834825) / Math.Sqrt((64.98406614609496 / (299)) + (13.818983602387325 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10187747965899253 = (58.57709970334515 - 52.609412419834825) / 58.57709970334515 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.40122503650151 < 103.87605497159409. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.603965118966099 (T) = (0 -82.48114831372435) / Math.Sqrt((159.16556406149593 / (299)) + (51.066892637676276 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07548708496290603 = (89.2157880892502 - 82.48114831372435) / 89.2157880892502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 67.70747433486812 < 91.37575081444584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.02174339479252 (T) = (0 -69.9364479479395) / Math.Sqrt((121.94351712925402 / (299)) + (5.134823475799449 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09210440497129033 = (77.03137709983928 - 69.9364479479395) / 77.03137709983928 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.LerpBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 136.445667135261 < 205.33097263101305. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.123180817368496 (T) = (0 -140.19483440906134) / Math.Sqrt((1073.5747681070682 / (299)) + (11.54851265953323 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1233448877772631 = (159.9201698072585 - 140.19483440906134) / 159.9201698072585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.30415880780305 < 104.45194916654827. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.854513446704334 (T) = (0 -82.50190350714263) / Math.Sqrt((162.31300417274952 / (299)) + (44.12192932327518 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07566637412341648 = (89.25554712877906 - 82.50190350714263) / 89.25554712877906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 116.59980730436244 < 141.76933576676294. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.631466191430693 (T) = (0 -116.6523967521538) / Math.Sqrt((202.26387375682648 / (299)) + (9.79979806663703 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.056930032186225124 = (123.69431827267009 - 116.6523967521538) / 123.69431827267009 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 136.32866319343805 < 178.44331908524737. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.648672511786469 (T) = (0 -138.63584805202638) / Math.Sqrt((428.3610342368513 / (299)) + (10.176761412443636 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08132084355510485 = (150.90779743879182 - 138.63584805202638) / 150.90779743879182 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[EqualsNotSame - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.EqualsNotSame.html>) 31.29 ns 24.31 ns 0.78 0.18 False
[EqualsSame - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.EqualsSame.html>) 46.32 ns 34.78 ns 0.75 0.21 False
[NotEqualsOperator - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.NotEqualsOperator.html>) 57.72 ns 35.61 ns 0.62 0.21 False
[ctor_bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.ctor_bytes.html>) 79.89 ns 62.00 ns 0.78 0.18 False
[EqualsOperator - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.EqualsOperator.html>) 47.25 ns 34.85 ns 0.74 0.18 False
[ParseExactD - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.ParseExactD.html>) 1.82 μs 1.16 μs 0.64 0.02 False
[ctor_str - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.ctor_str.html>) 1.86 μs 1.24 μs 0.67 0.04 False
[TryWriteBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.TryWriteBytes.html>) 52.85 ns 40.80 ns 0.77 0.18 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.Parse.html>) 1.89 μs 1.21 μs 0.64 0.04 False
[GuidToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Guid.GuidToString.html>) 936.24 ns 656.85 ns 0.70 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Guid*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Guid.EqualsNotSame ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.31406256652468 < 29.714021568637616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.320707691397649 (T) = (0 -24.643032484131663) / Math.Sqrt((6.719590244359738 / (299)) + (1.0129878533439751 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09817856374978581 = (27.32584466676433 - 24.643032484131663) / 27.32584466676433 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.EqualsSame ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.78128265640817 < 44.053832328107205. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.071941125189106 (T) = (0 -34.922800582875595) / Math.Sqrt((27.97627190935913 / (299)) + (3.220502981150466 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08243335869290457 = (38.06023345958528 - 34.922800582875595) / 38.06023345958528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.NotEqualsOperator ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 35.612990409955 < 46.81922554939494. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.781135074349964 (T) = (0 -36.061325523201745) / Math.Sqrt((31.88245093342255 / (299)) + (7.919391514838612 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09749008031619792 = (39.95670821638833 - 36.061325523201745) / 39.95670821638833 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.ctor_bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 61.9988646201487 < 75.42225543111809. IsChangePoint: Marked as a change because one of 4/21/2022 3:06:05 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.740358653419253 (T) = (0 -62.87646501159746) / Math.Sqrt((51.423162610499034 / (299)) + (6.790822445804422 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07000658844374552 = (67.60958113281657 - 62.87646501159746) / 67.60958113281657 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.EqualsOperator ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.85002151458369 < 45.17376467935284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.9343545053909414 (T) = (0 -35.54877976374445) / Math.Sqrt((27.737391461108214 / (299)) + (3.3755040340502154 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08030438293377391 = (38.65276631103552 - 35.54877976374445) / 38.65276631103552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.ParseExactD ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1612507141963728 < 1.724853374464683. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.27943373260582 (T) = (0 -1170.2742273307413) / Math.Sqrt((75247.72698069087 / (299)) + (286.4942339845355 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11273719395522273 = (1318.971357029567 - 1170.2742273307413) / 1318.971357029567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.ctor_str ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2390491455110406 < 1.7916006824632893. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.931481480268838 (T) = (0 -1222.3557672656618) / Math.Sqrt((86883.10865439306 / (299)) + (233.09855455811473 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1114610070662958 = (1375.691755777413 - 1222.3557672656618) / 1375.691755777413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.TryWriteBytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.80062784432299 < 50.37678763829701. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.960178453969068 (T) = (0 -40.707772897755376) / Math.Sqrt((36.71940837851307 / (299)) + (0.7836967559782668 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05947823325814848 = (43.28211673268864 - 40.707772897755376) / 43.28211673268864 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.Parse ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2124182035598707 < 1.8013039313402366. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.604524907544624 (T) = (0 -1226.3698586649275) / Math.Sqrt((83303.54630918137 / (299)) + (563.1754377975823 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10651021121342075 = (1372.5616946674033 - 1226.3698586649275) / 1372.5616946674033 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Guid.GuidToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 656.8538325338201 < 904.5982668389813. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.242637103251292 (T) = (0 -653.627615235647) / Math.Sqrt((14889.008757738922 / (299)) + (125.39881741945756 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11902957014596373 = (741.9404705149336 - 653.627615235647) / 741.9404705149336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Get

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetDateTime - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetDateTime.html>) 112.04 μs 72.41 μs 0.65 0.05 False
[GetDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetDouble.html>) 96.29 μs 60.91 μs 0.63 0.06 False
[GetUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetUInt64.html>) 16.76 μs 10.86 μs 0.65 0.17 False
[GetDecimal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetDecimal.html>) 102.54 μs 68.88 μs 0.67 0.05 False
[GetBoolean - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetBoolean.html>) 3.14 μs 2.20 μs 0.70 0.09 False
[GetString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetString.html>) 56.22 μs 44.35 μs 0.79 0.04 False
[GetDateTimeOffset - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetDateTimeOffset.html>) 154.87 μs 109.27 μs 0.71 0.03 False
[GetSingle - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetSingle.html>) 91.61 μs 62.07 μs 0.68 0.04 False
[GetUInt16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetUInt16.html>) 17.44 μs 11.73 μs 0.67 0.16 False
[GetUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetUInt32.html>) 18.08 μs 11.26 μs 0.62 0.18 False
[GetInt16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetInt16.html>) 18.03 μs 11.86 μs 0.66 0.22 False
[GetByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetByte.html>) 18.84 μs 11.95 μs 0.63 0.19 False
[GetGuid - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetGuid.html>) 159.13 μs 103.14 μs 0.65 0.04 False
[GetSByte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetSByte.html>) 19.48 μs 13.73 μs 0.71 0.18 False
[GetInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetInt32.html>) 18.65 μs 11.87 μs 0.64 0.17 False
[GetInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Get.GetInt64.html>) 18.45 μs 11.42 μs 0.62 0.11 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Get*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Get.GetDateTime ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 72.40696032530553 < 106.12805303273616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.505831868690747 (T) = (0 -73661.40458302098) / Math.Sqrt((224581921.6756205 / (299)) + (2076767.380975908 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11243308833108537 = (82992.50863747677 - 73661.40458302098) / 82992.50863747677 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetDouble ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 60.90648405230469 < 88.69262424413516. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.980420150583742 (T) = (0 -62486.297983772914) / Math.Sqrt((155232740.42632425 / (299)) + (1407979.1069896389 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10541686522343337 = (69849.62666368582 - 62486.297983772914) / 69849.62666368582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetUInt64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.864300618556701 < 15.771014375691879. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.553396550981965 (T) = (0 -10955.49049633533) / Math.Sqrt((4313541.837609557 / (299)) + (95989.97442642612 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13593799478258894 = (12679.055936013252 - 10955.49049633533) / 12679.055936013252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetDecimal ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.87666429859203 < 95.68782900172505. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.192841223309204 (T) = (0 -69656.57722523944) / Math.Sqrt((170189614.89507878 / (299)) + (1780382.0863542522 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10188245826896108 = (77558.41968188573 - 69656.57722523944) / 77558.41968188573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetBoolean ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.200671072403997 < 2.9936678401026318. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.40430210043237 (T) = (0 -2237.897357178001) / Math.Sqrt((95132.04507982147 / (299)) + (2266.4336230169615 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1410448836398805 = (2605.3717063369304 - 2237.897357178001) / 2605.3717063369304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 44.34720473569399 < 53.535615443243046. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.662601463840444 (T) = (0 -44545.4309965318) / Math.Sqrt((19113660.754515763 / (299)) + (565022.6936183684 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08730630146292638 = (48806.55039903551 - 44545.4309965318) / 48806.55039903551 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetDateTimeOffset ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.2711933908046 < 148.585805833684. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.111464356495723 (T) = (0 -109241.99065618252) / Math.Sqrt((391849636.0394593 / (299)) + (1989126.2879560553 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09701690934046076 = (120978.99925943477 - 109241.99065618252) / 120978.99925943477 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetSingle ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.07460463333335 < 87.0845832828423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.011275752210556 (T) = (0 -63060.64728234337) / Math.Sqrt((147642482.5731454 / (299)) + (782703.6924658375 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10165188635442575 = (70196.22607814895 - 63060.64728234337) / 70196.22607814895 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetUInt16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.728059048619446 < 16.644171373613258. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.061684999056352 (T) = (0 -11952.750485435025) / Math.Sqrt((5697320.442504352 / (299)) + (132453.03195598375 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09996415702043694 = (13280.304977483473 - 11952.750485435025) / 13280.304977483473 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetUInt32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.255715343915343 < 16.268649893938026. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.021685791669483 (T) = (0 -11554.267130789302) / Math.Sqrt((5433302.101361117 / (299)) + (180662.71189670687 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11259147521826651 = (13020.234546012709 - 11554.267130789302) / 13020.234546012709 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetInt16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.855896961746787 < 17.158141111277637. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.957544399382847 (T) = (0 -12053.089939226109) / Math.Sqrt((5637890.789974643 / (299)) + (149263.56554541335 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13635787618934272 = (13956.116320547373 - 12053.089939226109) / 13956.116320547373 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetByte ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.94800810648148 < 16.874870990108896. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.894449165832263 (T) = (0 -11866.842513037165) / Math.Sqrt((5886679.662126498 / (299)) + (73894.14400001515 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11743636277427173 = (13445.877455748894 - 11866.842513037165) / 13445.877455748894 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetGuid ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.14297661732456 < 151.22937183144748. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.617109656373202 (T) = (0 -103638.01345021054) / Math.Sqrt((432717465.4159527 / (299)) + (2106803.319180159 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13803655672916557 = (120234.81304142362 - 103638.01345021054) / 120234.81304142362 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetSByte ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.734595016180139 < 18.866225441105293. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.603127317301936 (T) = (0 -13095.271602574507) / Math.Sqrt((7385258.672986244 / (299)) + (116723.87421991637 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11700803651798714 = (14830.567144613957 - 13095.271602574507) / 14830.567144613957 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetInt32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.86773990603811 < 16.876669110745937. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.186209998074224 (T) = (0 -11963.83363269531) / Math.Sqrt((5792827.364541688 / (299)) + (101194.93565490797 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11977838333812363 = (13591.842561270605 - 11963.83363269531) / 13591.842561270605 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Get.GetInt64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.42038864266763 < 16.154324486853678. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.97690654332729 (T) = (0 -11398.181192209566) / Math.Sqrt((4500612.868666918 / (299)) + (76260.34558889444 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13586071511658118 = (13190.21295710135 - 11398.181192209566) / 13190.21295710135 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.AddGivenSize<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Stack(Size%3a%20512).html>) 19.64 μs 14.89 μs 0.76 0.10 False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).List(Size%3a%20512).html>) 18.22 μs 12.23 μs 0.67 0.12 False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).HashSet(Size%3a%20512).html>) 177.90 μs 120.26 μs 0.68 0.05 False
[ObservableCollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).ObservableCollection(Size%3a%20512).html>) 172.60 μs 138.02 μs 0.80 0.04 False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Queue(Size%3a%20512).html>) 32.34 μs 24.35 μs 0.75 0.05 False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).IDictionary(Size%3a%20512).html>) 191.79 μs 122.48 μs 0.64 0.03 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).Dictionary(Size%3a%20512).html>) 188.32 μs 119.94 μs 0.64 0.04 False
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).ICollection(Size%3a%20512).html>) 22.71 μs 17.69 μs 0.78 0.10 False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.AddGivenSize(String).SortedList(Size%3a%20512).html>) 1.86 ms 1.57 ms 0.85 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.894717655225106 < 18.651750040796273. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.180515076681576 (T) = (0 -15194.469046744856) / Math.Sqrt((2514316.5887594917 / (299)) + (366066.7992726807 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1092315613782337 = (17057.70926308791 - 15194.469046744856) / 17057.70926308791 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.229667488818734 < 17.312825830721675. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.519029460516043 (T) = (0 -12369.074798425267) / Math.Sqrt((6005420.3093019435 / (299)) + (678969.7761525445 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11000948376701224 = (13897.98494795107 - 12369.074798425267) / 13897.98494795107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 120.2637224519231 < 169.66843545476053. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.817883763799335 (T) = (0 -120276.08305098687) / Math.Sqrt((525570622.2750649 / (299)) + (3199128.8281986867 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12554502042578744 = (137544.05413707107 - 120276.08305098687) / 137544.05413707107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.ObservableCollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 138.02459281398913 < 157.95040463585988. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.75284104791727 (T) = (0 -139661.67888251445) / Math.Sqrt((60386407.337984495 / (299)) + (3012934.5045946836 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09446227308724693 = (154230.65735611322 - 139661.67888251445) / 154230.65735611322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.349647412896513 < 30.62879038440463. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 27.391320293082593 (T) = (0 -24575.960075318162) / Math.Sqrt((5525566.090595427 / (299)) + (57262.66847463408 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1346863055932101 = (28401.214766589415 - 24575.960075318162) / 28401.214766589415 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.47531790364583 < 180.34793244951922. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.91309119754671 (T) = (0 -124265.37461597515) / Math.Sqrt((655464254.9023305 / (299)) + (1942903.6939512491 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14316006406154957 = (145027.52428302026 - 124265.37461597515) / 145027.52428302026 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 119.94079624192601 < 178.363859276986. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.10874109726345 (T) = (0 -122357.4046279655) / Math.Sqrt((615676231.7552258 / (299)) + (3126714.8815204934 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14360863310942684 = (142875.56993040067 - 122357.4046279655) / 142875.56993040067 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.69316155195298 < 21.499024831532015. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.284135613927523 (T) = (0 -17768.680352884767) / Math.Sqrt((4703944.067977863 / (299)) + (50804.56035802776 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06317289252956405 = (18966.87255438486 - 17768.680352884767) / 18966.87255438486 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5726913625000005 < 1.7618010665046298. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.506876267112872 (T) = (0 -1581992.289585333) / Math.Sqrt((10107122498.759699 / (299)) + (839765764.069302 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07175803318303499 = (1704288.6942616305 - 1581992.289585333) / 1704288.6942616305 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Guids

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>) 160.10 ms 103.38 ms 0.65 0.02 False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>) 146.52 ms 97.41 ms 0.66 0.02 False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>) 163.51 ms 97.39 ms 0.60 0.03 False
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>) 157.98 ms 100.74 ms 0.64 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Guids*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 103.37843934615384 < 151.99608687875002. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.648371341048914 (T) = (0 -104499206.68306352) / Math.Sqrt((665742025380968.2 / (299)) + (1531231864670.7688 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11051648860865218 = (117483017.21704069 - 104499206.68306352) / 117483017.21704069 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 97.41352301666666 < 140.06236178166665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.175958834861754 (T) = (0 -95621233.13572109) / Math.Sqrt((461735217972379.8 / (299)) + (2142433609115.1558 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10775790496259967 = (107169605.27592336 - 95621233.13572109) / 107169605.27592336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 97.39061158333332 < 142.35852106608974. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.398205799259745 (T) = (0 -96581160.70906185) / Math.Sqrt((526304225763330.9 / (299)) + (1244979938957.289 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1149780256001746 = (109128545.39522369 - 96581160.70906185) / 109128545.39522369 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.73810510714286 < 150.06482302121793. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.154657619624153 (T) = (0 -102912807.91829005) / Math.Sqrt((526278841709514.5 / (299)) + (4546252026041.467 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10774552086455402 = (115340197.58355024 - 102912807.91829005) / 115340197.58355024 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in Benchstone.MDBenchF.MDSqMtx

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.MDBenchF.MDSqMtx.Test.html>) 8.99 secs 6.47 secs 0.72 0.15 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDSqMtx*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.MDBenchF.MDSqMtx.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.467142152399999 < 8.542356241701667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.109468313221127 (T) = (0 -6508963822.839313) / Math.Sqrt((1.1185242162567323E+18 / (299)) + (21140668154956432 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09879411392254336 = (7222504783.196547 - 6508963822.839313) / 7222504783.196547 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in MicroBenchmarks.Serializers.Json_ToString<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToString(Location).JsonNet.html>) 22.78 μs 19.19 μs 0.84 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_ToString&lt;Location&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Json_ToString<Location>.JsonNet_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.18626234331031 < 21.70092828693726. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.002315204657616 (T) = (0 -19369.459698618764) / Math.Sqrt((1223439.2182662073 / (299)) + (54247.84952096343 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0747650819147109 = (20934.63975473661 - 19369.459698618764) / 20934.63975473661 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>) 74.91 μs 56.72 μs 0.76 0.05 False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).ImmutableDictionary(Size%3a%20512).html>) 216.36 μs 162.53 μs 0.75 0.04 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>) 70.37 μs 52.27 μs 0.74 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyFalse<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.72358827184719 < 68.73221519889688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.56385386568126 (T) = (0 -54773.65920825323) / Math.Sqrt((46910615.99658296 / (299)) + (1404019.148220486 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09564966606827455 = (60566.85905131584 - 54773.65920825323) / 60566.85905131584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyFalse<Int32, Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 162.52789804718478 < 206.06173289454912. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.773184357494053 (T) = (0 -163074.4719561912) / Math.Sqrt((556939635.9615126 / (299)) + (7340029.647062807 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07060063332251909 = (175462.21549425815 - 163074.4719561912) / 175462.21549425815 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 52.27408682214525 < 66.18787057221701. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.119752558654998 (T) = (0 -52827.88181818848) / Math.Sqrt((45481614.71185246 / (299)) + (440854.6059726517 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09035908635257214 = (58075.53401084628 - 52827.88181818848) / 58075.53401084628 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in PerfLabTests.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IFooFooIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.IFooFooIsIFoo.html>) 988.71 μs 622.82 μs 0.63 0.09 False
[IntObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.IntObj.html>) 1.48 ms 1.08 ms 0.73 0.18 False
[FooObjIsNull - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.FooObjIsNull.html>) 978.67 μs 622.61 μs 0.64 0.13 False
[ObjFooIsObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjFooIsObj.html>) 978.63 μs 620.06 μs 0.63 0.11 False
[CheckIsInstAnyIsInterfaceNo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceNo.html>) 1.28 ms 839.32 μs 0.66 0.14 False
[FooObjIsFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.FooObjIsFoo.html>) 1.48 ms 1.08 ms 0.73 0.16 False
[ObjrefValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjrefValueTypeObj.html>) 1.48 ms 1.08 ms 0.73 0.19 False
[ObjScalarValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjScalarValueType.html>) 979.29 μs 624.06 μs 0.64 0.09 False
[ObjInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjInt.html>) 978.83 μs 623.35 μs 0.64 0.12 False
[FooObjCastIfIsa - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.FooObjCastIfIsa.html>) 2.36 ms 1.74 ms 0.74 0.15 False
[ScalarValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ScalarValueTypeObj.html>) 1.51 ms 1.21 ms 0.80 0.20 False
[CheckObjIsInterfaceNo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.CheckObjIsInterfaceNo.html>) 1.28 ms 839.27 μs 0.66 0.17 False
[ObjFooIsObj2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjFooIsObj2.html>) 978.76 μs 647.68 μs 0.66 0.13 False
[FooObjIsFoo2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.FooObjIsFoo2.html>) 1.51 ms 1.11 ms 0.74 0.19 False
[ObjObjrefValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.ObjObjrefValueType.html>) 979.60 μs 619.92 μs 0.63 0.10 False
[CheckObjIsInterfaceYes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.CheckObjIsInterfaceYes.html>) 1.29 ms 1.01 ms 0.78 0.17 False
[CheckIsInstAnyIsInterfaceYes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceYes.html>) 1.29 ms 871.71 μs 0.67 0.13 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf*'
### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.CastingPerf.IFooFooIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 622.8245784684067 < 930.8720983333333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.279854001581429 (T) = (0 -624931.74286696) / Math.Sqrt((17894545604.951633 / (299)) + (15478921.407978134 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.159378765968044 = (743416.5561932538 - 624931.74286696) / 743416.5561932538 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.IntObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0824238955555556 < 1.406539376216752. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.714135215627554 (T) = (0 -1070103.1463490129) / Math.Sqrt((17972266851.319473 / (299)) + (2457634649.2107005 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14442917839354513 = (1250747.5936822428 - 1070103.1463490129) / 1250747.5936822428 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsNull ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 622.6074745192307 < 929.9316600687886. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.495530793865932 (T) = (0 -625881.6725386286) / Math.Sqrt((17512864615.00243 / (299)) + (80027727.19669127 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16091536014515878 = (745910.0581878176 - 625881.6725386286) / 745910.0581878176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjFooIsObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 620.0588895 < 929.9457146226821. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.747893898481687 (T) = (0 -627605.9866299521) / Math.Sqrt((17384336473.615387 / (299)) + (219443458.45225918 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15627808693315168 = (743854.0790634019 - 627605.9866299521) / 743854.0790634019 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceNo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 839.3153848684213 < 1.2135567658367674. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.778561506355247 (T) = (0 -848632.7040128369) / Math.Sqrt((25417398449.21686 / (299)) + (1277574729.6591716 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1442695004028361 = (991705.5713362229 - 848632.7040128369) / 991705.5713362229 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.081908254761905 < 1.4068227096387984. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 9:07:46 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.202876006934147 (T) = (0 -1074350.7699339895) / Math.Sqrt((17913828165.758568 / (299)) + (1908502612.4485083 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.14189819406894216 = (1252008.5175305011 - 1074350.7699339895) / 1252008.5175305011 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjrefValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0821142486111113 < 1.4066350380611579. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.5884318042164525 (T) = (0 -1089543.923769074) / Math.Sqrt((23399703370.519566 / (299)) + (21886406261.05905 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13107424992358743 = (1253897.612855023 - 1089543.923769074) / 1253897.612855023 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjScalarValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 624.0566558333334 < 929.9553509309895. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.329311334469137 (T) = (0 -631305.6023402766) / Math.Sqrt((17462584550.69515 / (299)) + (576498305.6669792 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1492878063002722 = (742090.6941450351 - 631305.6023402766) / 742090.6941450351 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjInt ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 623.3515343333333 < 929.9864049096411. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.40694179672805 (T) = (0 -625896.555273593) / Math.Sqrt((17634721031.289074 / (299)) + (93388877.28396985 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16089488151004533 = (745909.5904455336 - 625896.555273593) / 745909.5904455336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjCastIfIsa ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7402408444444446 < 2.2450477514668368. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.495238155541692 (T) = (0 -1707094.597192316) / Math.Sqrt((41105609641.748184 / (299)) + (3464397538.6270537 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15094508748568847 = (2010582.0860715432 - 1707094.597192316) / 2010582.0860715432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ScalarValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2050198355769233 < 1.4096456783475377. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.24514215428846 (T) = (0 -1072112.5166230223) / Math.Sqrt((18603487685.095757 / (299)) + (2762353948.541386 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1452150937496461 = (1254248.3012785164 - 1072112.5166230223) / 1254248.3012785164 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.CheckObjIsInterfaceNo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 839.269032388664 < 1.2137801508333332. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.467270371561359 (T) = (0 -846038.714981433) / Math.Sqrt((26424613395.596382 / (299)) + (1081002795.605219 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15070361606131194 = (996164.2731337824 - 846038.714981433) / 996164.2731337824 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjFooIsObj2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 647.6803085508242 < 929.9084843261718. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.651696553113783 (T) = (0 -628211.9357069739) / Math.Sqrt((17379774580.006382 / (299)) + (270195431.38872975 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1562439539084834 = (744542.1441624087 - 628211.9357069739) / 744542.1441624087 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsFoo2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1092234858333334 < 1.4066966332778676. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.221167047290432 (T) = (0 -1063285.4146000133) / Math.Sqrt((18046804099.559048 / (299)) + (698156069.3992211 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15155007642913865 = (1253209.3940500063 - 1063285.4146000133) / 1253209.3940500063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjObjrefValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 619.9169784615385 < 929.8426229404548. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.965424798798798 (T) = (0 -626019.1682325128) / Math.Sqrt((18233469658.64725 / (299)) + (81433413.98961629 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1589103046596418 = (744295.3726584247 - 626019.1682325128) / 744295.3726584247 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.CheckObjIsInterfaceYes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0068933338675214 < 1.231796286125372. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.34911673060202 (T) = (0 -882862.4960022357) / Math.Sqrt((26712692238.320602 / (299)) + (1896423256.1194165 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12486931670192446 = (1008835.0378426014 - 882862.4960022357) / 1008835.0378426014 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceYes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 871.7143342592593 < 1.2355232631336805. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.025602086813402 (T) = (0 -881740.6641664698) / Math.Sqrt((27240216597.810043 / (299)) + (1015144606.5191867 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12475815573573494 = (1007425.17047693 - 881740.6641664698) / 1007425.17047693 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Ctor_Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address%3a%20%5b143%2c%2024%2c%2020%2c%2036%5d).html>) 100.34 ns 82.37 ns 0.82 0.17 False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address%3a%20143.24.20.36).html>) 492.23 ns 317.46 ns 0.64 0.08 False
[TryWriteBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address%3a%20143.24.20.36).html>) 71.37 ns 48.76 ns 0.68 0.20 False
[GetAddressBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address%3a%20143.24.20.36).html>) 101.76 ns 80.09 ns 0.79 0.11 False
[Ctor_Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address%3a%20%5b16%2c%2032%2c%2048%2c%2064%2c%2080%2c%20...%5d).html>) 360.11 ns 248.61 ns 0.69 0.11 False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>) 2.45 μs 1.77 μs 0.72 0.06 False
[Ctor_Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address%3a%20%5b143%2c%2024%2c%2020%2c%2036%5d).html>) 112.06 ns 94.18 ns 0.84 0.19 False
[Ctor_Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address%3a%20%5b16%2c%2032%2c%2048%2c%2064%2c%2080%2c%20...%5d).html>) 340.19 ns 242.42 ns 0.71 0.05 False
[GetAddressBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>) 399.97 ns 253.25 ns 0.63 0.09 False
[TryWriteBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>) 378.46 ns 220.81 ns 0.58 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [143, 24, 20, 36]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.36723410487164 < 94.13295725243789. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.89048385148484 (T) = (0 -83.99192271254537) / Math.Sqrt((54.88448705889446 / (299)) + (5.307977452143324 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05289078520407148 = (88.68240473263997 - 83.99192271254537) / 88.68240473263997 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 317.4612349551605 < 468.4970681109315. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.37161565723774 (T) = (0 -320.02545366273597) / Math.Sqrt((5212.2174943904865 / (299)) + (45.46532795061425 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12159538337090552 = (364.3257874609582 - 320.02545366273597) / 364.3257874609582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 48.76285950496209 < 69.1389418096419. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.408892225160855 (T) = (0 -49.5841510901613) / Math.Sqrt((112.86546366241544 / (299)) + (1.7174883672729795 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08714086767203491 = (54.31741802671377 - 49.5841510901613) / 54.31741802671377 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address: 143.24.20.36) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.0869461700696 < 97.0294843301156. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.53589349305938 (T) = (0 -80.13616775931514) / Math.Sqrt((74.17756250943204 / (299)) + (3.5199931996953926 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07456394381240088 = (86.59287394684176 - 80.13616775931514) / 86.59287394684176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [16, 32, 48, 64, 80, ...]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 248.61497557578602 < 334.22679067276573. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.449701486926198 (T) = (0 -253.19890808016763) / Math.Sqrt((1486.0274694765242 / (299)) + (74.89433588688692 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10216228034928253 = (282.0096578017113 - 253.19890808016763) / 282.0096578017113 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.7712275807464053 < 2.338453859310841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.142934700213837 (T) = (0 -1750.6298273484604) / Math.Sqrt((69242.91468494035 / (299)) + (909.6913873834643 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11985192860648462 = (1989.017398602867 - 1750.6298273484604) / 1989.017398602867 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [143, 24, 20, 36]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 94.18148426530927 < 107.60573262033972. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.758507933027298 (T) = (0 -91.96655350672646) / Math.Sqrt((77.3276463275943 / (299)) + (11.950116457245898 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06794730783777513 = (98.67098102938537 - 91.96655350672646) / 98.67098102938537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [16, 32, 48, 64, 80, ...]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 242.4197867439064 < 321.6409169544606. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.643140438023822 (T) = (0 -244.58946307029447) / Math.Sqrt((1391.786946239129 / (299)) + (12.760575770022534 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09521210782553352 = (270.32795772993313 - 244.58946307029447) / 270.32795772993313 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 253.25068601785355 < 379.97185370236537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.263470566509442 (T) = (0 -256.2525741107864) / Math.Sqrt((3547.3977173877875 / (299)) + (33.44882657436791 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12392070110443827 = (292.49929136989516 - 256.2525741107864) / 292.49929136989516 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 220.8103087724596 < 353.2617791679346. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.373426177678637 (T) = (0 -224.88355788502835) / Math.Sqrt((3966.402641151245 / (299)) + (26.037282645035454 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13378561509987394 = (259.6165127308031 - 224.88355788502835) / 259.6165127308031 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.IterateForEach<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableSortedDictionary(Size%3a%20512).html>) 176.61 μs 144.59 μs 0.82 0.05 False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).Queue(Size%3a%20512).html>) 34.90 μs 24.80 μs 0.71 0.04 False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableList(Size%3a%20512).html>) 182.93 μs 158.55 μs 0.87 0.06 False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ConcurrentStack(Size%3a%20512).html>) 30.33 μs 22.91 μs 0.76 0.06 False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).HashSet(Size%3a%20512).html>) 24.54 μs 17.46 μs 0.71 0.10 False
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ConcurrentQueue(Size%3a%20512).html>) 49.00 μs 37.35 μs 0.76 0.08 False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableDictionary(Size%3a%20512).html>) 305.63 μs 257.35 μs 0.84 0.03 False
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).LinkedList(Size%3a%20512).html>) 25.70 μs 18.23 μs 0.71 0.07 False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableArray(Size%3a%20512).html>) 15.85 μs 12.71 μs 0.80 0.12 False
[ReadOnlySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ReadOnlySpan(Size%3a%20512).html>) 6.82 μs 4.10 μs 0.60 0.07 False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ConcurrentDictionary(Size%3a%20512).html>) 110.36 μs 80.45 μs 0.73 0.05 False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableSortedSet(Size%3a%20512).html>) 176.30 μs 140.80 μs 0.80 0.07 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).Dictionary(Size%3a%20512).html>) 30.97 μs 22.54 μs 0.73 0.15 False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableHashSet(Size%3a%20512).html>) 319.73 μs 274.83 μs 0.86 0.05 False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).SortedDictionary(Size%3a%20512).html>) 115.84 μs 86.37 μs 0.75 0.11 False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ConcurrentBag(Size%3a%20512).html>) 34.81 μs 26.62 μs 0.76 0.10 False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).List(Size%3a%20512).html>) 20.27 μs 14.14 μs 0.70 0.12 False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).Span(Size%3a%20512).html>) 6.87 μs 4.10 μs 0.60 0.08 False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).Stack(Size%3a%20512).html>) 33.19 μs 23.71 μs 0.71 0.06 False
[SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).SortedSet(Size%3a%20512).html>) 101.76 μs 81.72 μs 0.80 0.04 False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).Array(Size%3a%20512).html>) 4.47 μs 2.78 μs 0.62 0.07 False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).SortedList(Size%3a%20512).html>) 42.06 μs 30.24 μs 0.72 0.08 False
[ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableStack(Size%3a%20512).html>) 47.00 μs 34.76 μs 0.74 0.10 False
[ImmutableQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).ImmutableQueue(Size%3a%20512).html>) 48.06 μs 34.71 μs 0.72 0.10 False
[IEnumerable - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IterateForEach(Int32).IEnumerable(Size%3a%20512).html>) 26.95 μs 21.44 μs 0.80 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForEach<Int32>.ImmutableSortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 144.5930159668313 < 167.65559857625368. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.689097970529126 (T) = (0 -145210.67470151107) / Math.Sqrt((99463110.27938701 / (299)) + (7021243.649483795 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09563369181369931 = (160566.2145825953 - 145210.67470151107) / 160566.2145825953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.79516995268139 < 33.17198142374191. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.109066382669095 (T) = (0 -25006.84021415155) / Math.Sqrt((17228794.76420141 / (299)) + (166377.00907045475 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11429124815614922 = (28233.70567592655 - 25006.84021415155) / 28233.70567592655 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 158.54990573432343 < 173.8897534593593. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.84507309538548 (T) = (0 -149675.30807633288) / Math.Sqrt((168050029.74756262 / (299)) + (10888698.060904844 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09890736536257302 = (166104.2409214207 - 149675.30807633288) / 166104.2409214207 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ConcurrentStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.91413655923552 < 28.794847149766532. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.82295019505567 (T) = (0 -23242.16875043765) / Math.Sqrt((6834277.6419496 / (299)) + (261510.08854096875 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10148778117596358 = (25867.393078812842 - 23242.16875043765) / 25867.393078812842 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.460405648148146 < 23.317858084345115. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.479883408402387 (T) = (0 -17455.328757536037) / Math.Sqrt((6290640.01508158 / (299)) + (27727.374414988608 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13446755839136573 = (20167.157137512324 - 17455.328757536037) / 20167.157137512324 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 37.347585013922036 < 46.84164517804394. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.34449192650653 (T) = (0 -37591.66017303432) / Math.Sqrt((19217730.71982322 / (299)) + (312708.5401790073 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10313981019659069 = (41914.73832869576 - 37591.66017303432) / 41914.73832869576 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 257.3496974726776 < 292.4691088825229. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.578662214255264 (T) = (0 -260732.09808453682) / Math.Sqrt((273193083.5927602 / (299)) + (12928632.327564757 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07083253353460985 = (280608.2945159258 - 260732.09808453682) / 280608.2945159258 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.LinkedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.22696389537145 < 24.411172984266585. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.404436361200188 (T) = (0 -18461.706307669032) / Math.Sqrt((8444491.079595597 / (299)) + (631211.1556025579 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10097580334121085 = (20535.271882872235 - 18461.706307669032) / 20535.271882872235 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.708341854296066 < 15.0569087751118. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.740017481840221 (T) = (0 -12161.750698524758) / Math.Sqrt((2559368.82826287 / (299)) + (28460.14859550192 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06408122096712418 = (12994.450983334265 - 12161.750698524758) / 12994.450983334265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ReadOnlySpan(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.0961879334227 < 6.522728453325052. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.218291277930645 (T) = (0 -4109.156634150941) / Math.Sqrt((1239046.2279434893 / (299)) + (11831.714549702674 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16403998627829575 = (4915.494242190993 - 4109.156634150941) / 4915.494242190993 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.45387943786982 < 104.79029530788313. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.216947828368365 (T) = (0 -82028.40347322759) / Math.Sqrt((131058461.07845575 / (299)) + (1497794.2040562765 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09224690530564202 = (90364.22343550004 - 82028.40347322759) / 90364.22343550004 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.79568981060604 < 167.6336859092429. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.42105838563412 (T) = (0 -143106.41459393947) / Math.Sqrt((141963916.5967526 / (299)) + (4989451.231422343 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09691058104323194 = (158463.1727379259 - 143106.41459393947) / 158463.1727379259 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.544810404157694 < 29.403703280144978. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.417785610523985 (T) = (0 -21762.921438892467) / Math.Sqrt((13706857.506065147 / (299)) + (253572.77252430512 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12155332299126359 = (24774.32268626594 - 21762.921438892467) / 24774.32268626594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 274.828270474138 < 310.1225035937499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.60206387859696 (T) = (0 -272220.5700733167) / Math.Sqrt((280837495.5384361 / (299)) + (30710420.39741351 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07693496840867721 = (294909.4167330991 - 272220.5700733167) / 294909.4167330991 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.SortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 86.36881719034609 < 109.54830255767155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.451323471777712 (T) = (0 -84952.01039563764) / Math.Sqrt((114958220.82750346 / (299)) + (2547251.172867623 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11871034325631406 = (96395.10658678372 - 84952.01039563764) / 96395.10658678372 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 26.6172705955335 < 32.641720298939504. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.864189466501188 (T) = (0 -25629.697022329845) / Math.Sqrt((10867686.011800472 / (299)) + (873585.5105043843 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10290532874673998 = (28569.668111532334 - 25629.697022329845) / 28569.668111532334 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.143771888748704 < 19.25301926112649. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.812535033389647 (T) = (0 -14314.066739178987) / Math.Sqrt((5747580.561967062 / (299)) + (58910.8445099396 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12842456158544388 = (16423.210324991564 - 14314.066739178987) / 16423.210324991564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.102415185739134 < 6.521931827978477. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.517121960901646 (T) = (0 -4149.564966716212) / Math.Sqrt((1218938.5224561805 / (299)) + (59782.42558940705 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15382173206959882 = (4903.889787745668 - 4149.564966716212) / 4903.889787745668 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.71165171059638 < 31.587278586052705. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.517347001733068 (T) = (0 -24052.764809769746) / Math.Sqrt((13490979.22463054 / (299)) + (629453.995597087 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10207412531791929 = (26787.027178925942 - 24052.764809769746) / 26787.027178925942 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.SortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.71712557508681 < 96.33089819862813. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.221250108464888 (T) = (0 -75284.04036471766) / Math.Sqrt((105986510.17920142 / (299)) + (1926717.555537024 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10546026772063685 = (84159.52656779988 - 75284.04036471766) / 84159.52656779988 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.776599623579123 < 4.267512317378015. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.262783683502358 (T) = (0 -2740.167819605911) / Math.Sqrt((618456.1022020332 / (299)) + (513.8556177639549 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1208366874364289 = (3116.7904534321356 - 2740.167819605911) / 3116.7904534321356 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.240310347719145 < 39.511520236238155. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.645158787330637 (T) = (0 -30647.264915586893) / Math.Sqrt((16584267.375605904 / (299)) + (182199.71115863795 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11630282933907715 = (34680.732193207776 - 30647.264915586893) / 34680.732193207776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.76498068260568 < 44.614868003562414. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.107137625728994 (T) = (0 -35060.25336384883) / Math.Sqrt((17859520.47206637 / (299)) + (2866999.469427491 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12595987640445064 = (40112.864864396666 - 35060.25336384883) / 40112.864864396666 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.ImmutableQueue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 34.70544115892459 < 45.72069438270445. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.37605952792935 (T) = (0 -35228.491761988545) / Math.Sqrt((18456690.846808262 / (299)) + (630110.6503602233 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.129684124797197 = (40477.82278334234 - 35228.491761988545) / 40477.82278334234 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IterateForEach<Int32>.IEnumerable(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.435563290525113 < 25.528329919292876. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.025837388033557 (T) = (0 -21611.543792012544) / Math.Sqrt((5300447.855583437 / (299)) + (176307.11877439107 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06865258624607498 = (23204.599564950975 - 21611.543792012544) / 23204.599564950975 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in Microsoft.Extensions.Logging.LoggingOverhead

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[NoArguments_DefineMessage_FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage_FilteredByLevel.html>) 95.85 ns 69.93 ns 0.73 0.22 False
[NoArguments_DefineMessage - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage.html>) 284.74 ns 219.45 ns 0.77 0.15 False
[NoArguments_FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_FilteredByLevel.html>) 171.03 ns 141.57 ns 0.83 0.19 False
[TwoArguments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments.html>) 685.32 ns 528.70 ns 0.77 0.09 False
[TwoArguments_FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_FilteredByLevel.html>) 656.79 ns 486.23 ns 0.74 0.06 False
[NoArguments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.NoArguments.html>) 226.53 ns 159.78 ns 0.71 0.23 False
[TwoArguments_DefineMessage - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_DefineMessage.html>) 306.26 ns 229.77 ns 0.75 0.13 False
[TwoArguments_DefineMessage_FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_DefineMessage_FilteredByLevel.html>) 99.27 ns 74.68 ns 0.75 0.21 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Logging.LoggingOverhead*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage_FilteredByLevel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.92977543192733 < 91.1319708855141. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.194913623499593 (T) = (0 -72.0489782758429) / Math.Sqrt((114.4473619691466 / (299)) + (3.6947944495795237 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10208574953859535 = (80.24037733984021 - 72.0489782758429) / 80.24037733984021 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 219.4481899324293 < 269.3727365958234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.17023068772617 (T) = (0 -220.11455366646146) / Math.Sqrt((454.14214768630103 / (299)) + (52.56582794191053 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1145806964091436 = (248.59922612233248 - 220.11455366646146) / 248.59922612233248 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_FilteredByLevel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 141.56555123422874 < 164.2643641268342. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.201556918652837 (T) = (0 -133.45668434537717) / Math.Sqrt((243.59769705633872 / (299)) + (13.083211182856386 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09213691786020256 = (147.00089360482093 - 133.45668434537717) / 147.00089360482093 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 528.6963099371977 < 651.409275506929. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.143224205434173 (T) = (0 -525.486061332277) / Math.Sqrt((2915.164014343587 / (299)) + (90.84047781332475 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0939819023936738 = (579.9951046459183 - 525.486061332277) / 579.9951046459183 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_FilteredByLevel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 486.2290436264799 < 604.8472181137214. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.592739529755423 (T) = (0 -492.57504043965565) / Math.Sqrt((2605.008614082793 / (299)) + (82.80110918779465 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09178025274739622 = (542.3522687430132 - 492.57504043965565) / 542.3522687430132 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 159.77890940929214 < 204.26349501277923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.600730008208268 (T) = (0 -162.5918271550769) / Math.Sqrt((373.53196681641583 / (299)) + (17.77215154496214 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10739568272731978 = (182.15442610883878 - 162.5918271550769) / 182.15442610883878 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_DefineMessage ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 229.76520536703353 < 288.35831412927024. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.642608965427202 (T) = (0 -234.44853893286856) / Math.Sqrt((585.3692938041847 / (299)) + (42.086598877019256 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09941145856512212 = (260.3281389293822 - 234.44853893286856) / 260.3281389293822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_DefineMessage_FilteredByLevel ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.67764023117601 < 95.91716760320196. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.302282296666128 (T) = (0 -73.99262198944483) / Math.Sqrt((109.91414677198678 / (299)) + (13.355146218126256 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09779548355745306 = (82.01313631326377 - 73.99262198944483) / 82.01313631326377 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.Concurrent.Count<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Bag(Size%3a%20512).html>) 501.46 ns 459.82 ns 0.92 0.08 False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Queue(Size%3a%20512).html>) 81.06 ns 57.92 ns 0.71 0.23 False
[Queue_EnqueueCountDequeue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Queue_EnqueueCountDequeue(Size%3a%20512).html>) 301.02 ns 236.13 ns 0.78 0.14 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Dictionary(Size%3a%20512).html>) 158.43 μs 138.44 μs 0.87 0.08 False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.Count(Int32).Stack(Size%3a%20512).html>) 2.73 μs 1.58 μs 0.58 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.Count&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Concurrent.Count<Int32>.Bag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 459.8184121641255 < 485.9209184385793. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.338060210656273 (T) = (0 -453.69859615418284) / Math.Sqrt((382.2484427272102 / (299)) + (96.92886414227277 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06217117338017321 = (483.77548575620966 - 453.69859615418284) / 483.77548575620966 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.92350473799792 < 77.09650531316855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.805294317434889 (T) = (0 -56.32399586300772) / Math.Sqrt((100.54262151183626 / (299)) + (2.4751043428728994 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1232182688149633 = (64.23947244758577 - 56.32399586300772) / 64.23947244758577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Queue_EnqueueCountDequeue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 236.12621741025976 < 287.43209976912163. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.89762667981186 (T) = (0 -233.82112779552236) / Math.Sqrt((660.801724461037 / (299)) + (27.246724235559658 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10608314216036797 = (261.5692116609235 - 233.82112779552236) / 261.5692116609235 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 138.43705960687544 < 151.41525195871483. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.741988730441777 (T) = (0 -140757.35085873588) / Math.Sqrt((49838883.362189226 / (299)) + (7738248.745887408 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.054667078620386146 = (148897.1215064798 - 140757.35085873588) / 148897.1215064798 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.Count<Int32>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.579044968216738 < 2.5901231231037887. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.28365404027468 (T) = (0 -1735.7179758373286) / Math.Sqrt((135802.31208256749 / (299)) + (62257.44520137623 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15971336629200686 = (2065.6260687832214 - 1735.7179758373286) / 2065.6260687832214 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Doubles

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>) 693.23 ms 548.11 ms 0.79 0.03 False
[WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>) 748.36 ms 602.52 ms 0.81 0.01 False
[WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>) 743.24 ms 588.60 ms 0.79 0.02 False
[WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>) 704.88 ms 555.91 ms 0.79 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Doubles*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 548.1050281333333 < 660.0289644228571. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.954993493893992 (T) = (0 -556627296.1662775) / Math.Sqrt((3126176851745610.5 / (299)) + (32428774530774.508 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08193544120568746 = (606305178.4694663 - 556627296.1662775) / 606305178.4694663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 602.5160198666666 < 713.7507200738462. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.603652657729553 (T) = (0 -603369011.8209623) / Math.Sqrt((3443541091288008.5 / (299)) + (34469308120460.8 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06280781000972115 = (643804993.538434 - 603369011.8209623) / 643804993.538434 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 588.5984474666667 < 703.4087718331042. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.778195256917408 (T) = (0 -594657116.9559361) / Math.Sqrt((3437194711272889.5 / (299)) + (43427597407616.08 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06488151768711822 = (635916333.8159425 - 594657116.9559361) / 635916333.8159425 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 555.9105661333333 < 667.6368672783333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.55837562603134 (T) = (0 -564079389.8146489) / Math.Sqrt((2821984502021755 / (299)) + (33988796887502.46 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08039017670458715 = (613389913.3365886 - 564079389.8146489) / 613389913.3365886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Reader.Tests.Perf_Base64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes%3a%201000).html>) 30.18 μs 18.55 μs 0.61 0.07 False
[ReadBase64EncodedByteArray_NoEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes%3a%201000).html>) 29.91 μs 18.54 μs 0.62 0.06 False
[ReadBase64EncodedByteArray_NoEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes%3a%20100).html>) 3.96 μs 2.52 μs 0.64 0.08 False
[ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes%3a%20100).html>) 3.90 μs 2.52 μs 0.65 0.06 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.545269464215103 < 28.460627928486236. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.877266723513843 (T) = (0 -18437.056804096483) / Math.Sqrt((21039385.505367488 / (299)) + (84224.43261022233 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14726870651606858 = (21621.18001881903 - 18437.056804096483) / 21621.18001881903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.535500503772933 < 28.397444398886925. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.504895957855206 (T) = (0 -18472.219325247435) / Math.Sqrt((20960503.670305643 / (299)) + (201711.4381821219 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14463136809478072 = (21595.62396402477 - 18472.219325247435) / 21595.62396402477 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_NoEscaping(NumberOfBytes: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5239239530715336 < 3.7349697296142423. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.602047757796603 (T) = (0 -2504.6414995713662) / Math.Sqrt((315265.7444932559 / (299)) + (808.3329182638777 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1315372921031769 = (2883.99430026986 - 2504.6414995713662) / 2883.99430026986 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.516642382981602 < 3.7084401838323067. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.719849117642628 (T) = (0 -2502.8469475881466) / Math.Sqrt((315586.3951613478 / (299)) + (303.1005717286541 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13234014623227305 = (2884.5946216363263 - 2502.8469475881466) / 2884.5946216363263 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(ImmutableSortedDictionary(String%2c%20String)).DeserializeFromUtf8Bytes.html>) 773.23 μs 627.30 μs 0.81 0.04 False
[DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(ImmutableSortedDictionary(String%2c%20String)).DeserializeFromString.html>) 835.20 μs 669.60 μs 0.80 0.02 False
[DeserializeFromStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.ReadJson(ImmutableSortedDictionary(String%2c%20String)).DeserializeFromStream.html>) 796.52 μs 656.77 μs 0.82 0.02 False

Test Report.html>)

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;ImmutableSortedDictionary&lt;String, String&gt;&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 627.303877857143 < 739.600979955357. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.832449134410465 (T) = (0 -628273.804152878) / Math.Sqrt((3226313521.4544516 / (299)) + (30987809.778855298 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07365685528194675 = (678230.1005143216 - 628273.804152878) / 678230.1005143216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 669.6039502508361 < 786.6376631009615. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.952242841882969 (T) = (0 -661874.5437951585) / Math.Sqrt((4004149658.2779074 / (299)) + (53685433.942356154 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07887609826449672 = (718551.0467680958 - 661874.5437951585) / 718551.0467680958 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 656.7692210791927 < 764.4985032552082. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.69816777826605 (T) = (0 -655766.673431583) / Math.Sqrt((3227579227.2328563 / (299)) + (37423465.79705673 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0705680198567049 = (705556.3908296766 - 655766.673431583) / 705556.3908296766 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Buffers.Text.Tests.Utf8ParserTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TryParseUInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value%3a%2012345).html>) 161.86 ns 101.42 ns 0.63 0.18 False
[TryParseSingle - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value%3a%2012345).html>) 630.32 ns 416.73 ns 0.66 0.13 False
[TryParseInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value%3a%20-2147483648).html>) 334.30 ns 202.20 ns 0.60 0.10 False
[TryParseBool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value%3a%20true).html>) 70.12 ns 47.28 ns 0.67 0.18 False
[TryParseInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value%3a%202147483647).html>) 335.00 ns 195.27 ns 0.58 0.12 False
[TryParseBool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value%3a%20false).html>) 88.65 ns 57.60 ns 0.65 0.20 False
[TryParseSByte - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value%3a%20-128).html>) 163.87 ns 100.57 ns 0.61 0.21 False
[TryParseInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value%3a%20-9223372036854775808).html>) 562.64 ns 318.51 ns 0.57 0.08 False
[TryParseByte - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value%3a%200).html>) 81.70 ns 55.22 ns 0.68 0.21 False
[TryParseUInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value%3a%2012345).html>) 186.51 ns 117.58 ns 0.63 0.16 False
[TryParseSingle - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value%3a%203.4028235E%2b38).html>) 1.35 μs 924.72 ns 0.69 0.05 False
[TryParseBool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value%3a%20False).html>) 88.67 ns 57.30 ns 0.65 0.19 False
[TryParseInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value%3a%204).html>) 87.20 ns 59.73 ns 0.68 0.21 False
[TryParseBool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value%3a%20%20True%20).html>) 91.76 ns 59.37 ns 0.65 0.23 False
[TryParseUInt32Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value%3a%203039).html>) 198.16 ns 120.86 ns 0.61 0.26 False
[TryParseUInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value%3a%204294967295).html>) 305.30 ns 189.72 ns 0.62 0.12 False
[TryParseUInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value%3a%200).html>) 79.06 ns 55.22 ns 0.70 0.19 False
[TryParseUInt32Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value%3a%200).html>) 108.15 ns 74.12 ns 0.69 0.24 False
[TryParseInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value%3a%200).html>) 87.19 ns 68.68 ns 0.79 0.26 False
[TryParseBool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value%3a%20TRUE).html>) 73.51 ns 47.06 ns 0.64 0.20 False
[TryParseUInt64Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value%3a%20FFFFFFFFFFFFFFFF).html>) 545.55 ns 331.98 ns 0.61 0.13 False
[TryParseUInt64Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value%3a%203039).html>) 211.72 ns 124.97 ns 0.59 0.20 False
[TryParseInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value%3a%2032767).html>) 209.18 ns 126.96 ns 0.61 0.20 False
[TryParseDouble - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value%3a%20-1.7976931348623157e%2b308).html>) 1.62 μs 1.09 μs 0.67 0.05 False
[TryParseUInt64Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value%3a%200).html>) 108.76 ns 82.70 ns 0.76 0.28 False
[TryParseInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value%3a%2012345).html>) 179.65 ns 110.14 ns 0.61 0.16 False
[TryParseUInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value%3a%200).html>) 77.92 ns 54.50 ns 0.70 0.21 False
[TryParseSingle - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value%3a%20-3.4028235E%2b38).html>) 1.37 μs 929.89 ns 0.68 0.06 False
[TryParseInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value%3a%20-32768).html>) 215.28 ns 131.61 ns 0.61 0.18 False
[TryParseInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value%3a%209223372036854775807).html>) 530.12 ns 308.91 ns 0.58 0.07 False
[TryParseInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value%3a%2012345).html>) 173.50 ns 105.21 ns 0.61 0.23 False
[TryParseDouble - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value%3a%201.7976931348623157e%2b308).html>) 1.63 μs 1.08 μs 0.66 0.06 False
[TryParseUInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value%3a%200).html>) 80.86 ns 54.79 ns 0.68 0.24 False
[TryParseUInt16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value%3a%2065535).html>) 184.77 ns 117.36 ns 0.64 0.14 False
[TryParseUInt32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value%3a%2012345).html>) 179.08 ns 109.19 ns 0.61 0.17 False
[TryParseUInt32Hex - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value%3a%20FFFFFFFFFFFFFFFF).html>) 293.67 ns 189.27 ns 0.64 0.22 False
[TryParseUInt64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value%3a%2018446744073709551615).html>) 542.89 ns 312.28 ns 0.58 0.12 False
[TryParseSByte - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value%3a%20127).html>) 149.87 ns 96.03 ns 0.64 0.22 False
[TryParseDateTimeOffset - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseDateTimeOffset(value%3a%2012%2f30%2f2017%203%3a45%3a22%20AM%20-08%3a00).html>) 226.47 ns 145.94 ns 0.64 0.25 False
[TryParseDouble - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value%3a%2012345).html>) 612.95 ns 421.55 ns 0.69 0.14 False
[TryParseDecimal - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseDecimal(value%3a%20123456.789).html>) 969.61 ns 684.78 ns 0.71 0.07 False
[TryParseByte - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value%3a%20255).html>) 130.77 ns 84.20 ns 0.64 0.21 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 101.42460821412924 < 153.31434202529465. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.515431957801772 (T) = (0 -102.84680635354994) / Math.Sqrt((554.7408516970368 / (299)) + (12.488692596955243 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13909884114640103 = (119.46412813580567 - 102.84680635354994) / 119.46412813580567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 416.7346987546436 < 597.4563682071024. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.581538808733065 (T) = (0 -433.69094513100475) / Math.Sqrt((7318.723639528286 / (299)) + (102.80325090678836 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09225600703976444 = (477.7679042707837 - 433.69094513100475) / 477.7679042707837 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 202.19814188113054 < 317.58062227373665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.380070405655797 (T) = (0 -201.65457926073498) / Math.Sqrt((3479.179084654497 / (299)) + (93.88907945050212 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13192825720596416 = (232.3017434154412 - 201.65457926073498) / 232.3017434154412 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: true) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.27773148788511 < 68.15934587543603. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.883737544940098 (T) = (0 -48.18550764746726) / Math.Sqrt((107.78240311320799 / (299)) + (2.7010168155816237 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08376933363705459 = (52.59102256284837 - 48.18550764746726) / 52.59102256284837 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 2147483647) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 195.26631335723133 < 312.64656944577644. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.9667117150376265 (T) = (0 -197.24152235910734) / Math.Sqrt((3103.0231604852547 / (299)) + (108.66745435312366 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1243162507217002 = (225.24287166647224 - 197.24152235910734) / 225.24287166647224 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: false) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.603329752553634 < 84.23091563844602. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.9392884486094975 (T) = (0 -59.20784567501156) / Math.Sqrt((177.99046814579876 / (299)) + (10.754434643311832 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09419907811870916 = (65.36518593074584 - 59.20784567501156) / 65.36518593074584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value: -128) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.56798242841987 < 154.84936630000638. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.142986927368746 (T) = (0 -101.93143437319738) / Math.Sqrt((615.3042787262023 / (299)) + (12.62794865371013 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13071052920738183 = (117.25833315369194 - 101.93143437319738) / 117.25833315369194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: -9223372036854775808) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 318.51035648809403 < 535.2026323891982. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.206919380881999 (T) = (0 -320.69232384457445) / Math.Sqrt((8614.263237213592 / (299)) + (24.615860822950477 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1707186486438416 = (386.71112442132323 - 320.69232384457445) / 386.71112442132323 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.219086836524326 < 76.5569755858018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.826120196143457 (T) = (0 -55.48935162243113) / Math.Sqrt((119.740832718297 / (299)) + (7.994484276898618 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10493200098584234 = (61.994565422457285 - 55.48935162243113) / 61.994565422457285 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.58382141438356 < 177.13756163035399. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.249250797755726 (T) = (0 -119.46148796213784) / Math.Sqrt((868.3771656121288 / (299)) + (8.692876311141873 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10781231320974231 = (133.8972614516947 - 119.46148796213784) / 133.8972614516947 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: 3.4028235E+38) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 924.7161457610255 < 1.2811318207964728. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.366631990993659 (T) = (0 -928.0104730786886) / Math.Sqrt((33682.43562140163 / (299)) + (136.89407302816775 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09772003804283583 = (1028.5172143973048 - 928.0104730786886) / 1028.5172143973048 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.2985375615998 < 84.2734371681404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 5.8231274647427345 (T) = (0 -59.80179497306753) / Math.Sqrt((180.76493605057757 / (299)) + (19.491233381508728 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0870533885853798 = (65.50415350181763 - 59.80179497306753) / 65.50415350181763 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.7302732805363 < 82.87118344534645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.668897350577447 (T) = (0 -59.85858025268535) / Math.Sqrt((107.94582794459903 / (299)) + (10.298217711853237 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1354818322560456 = (69.23923925033552 - 59.85858025268535) / 69.23923925033552 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: True ) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 59.3677291825331 < 75.47439933846756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.383249521596982 (T) = (0 -53.77264040134753) / Math.Sqrt((139.56583829543948 / (299)) + (6.530870209675963 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08313226966286297 = (58.64819823201221 - 53.77264040134753) / 58.64819823201221 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: 3039) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 120.8571872517306 < 178.4552666682828. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.849274549229415 (T) = (0 -124.92235480997134) / Math.Sqrt((683.9710826698432 / (299)) + (42.99057589099697 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13179630584340232 = (143.88599777996237 - 124.92235480997134) / 143.88599777996237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 4294967295) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 189.72156952371003 < 289.9384047208911. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.834936063022619 (T) = (0 -187.70698033634716) / Math.Sqrt((2752.5200532783147 / (299)) + (18.65716405636479 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11419397325711932 = (211.90528701475193 - 187.70698033634716) / 211.90528701475193 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.2163935171549 < 74.80313750793599. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.23443991097221 (T) = (0 -53.6017466332328) / Math.Sqrt((112.83235703792086 / (299)) + (0.9938865390383709 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12547025725201177 = (61.29207963219511 - 53.6017466332328) / 61.29207963219511 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.1243995621886 < 101.8117183512499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.712718971445993 (T) = (0 -75.41116673718601) / Math.Sqrt((190.60640231898816 / (299)) + (7.768407093766651 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11139470631453047 = (84.86463818420434 - 75.41116673718601) / 84.86463818420434 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.67516638929553 < 82.50114084355695. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.288856655824294 (T) = (0 -59.84792098015045) / Math.Sqrt((112.96735254251668 / (299)) + (6.068339770715416 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12524176821214017 = (68.41652791061055 - 59.84792098015045) / 68.41652791061055 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: TRUE) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.05687895286467 < 66.74762006914466. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.390625912006479 (T) = (0 -48.29547019589312) / Math.Sqrt((102.80094034762197 / (299)) + (5.353087000919389 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08078737810247677 = (52.54004247265139 - 48.29547019589312) / 52.54004247265139 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: FFFFFFFFFFFFFFFF) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 331.9828442523506 < 518.1260089256338. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.279983769427522 (T) = (0 -335.65018598960194) / Math.Sqrt((7031.395493065177 / (299)) + (34.26329389583247 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15236419062944237 = (395.98396183716096 - 335.65018598960194) / 395.98396183716096 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: 3039) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 124.96759167818816 < 184.86217303180158. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.338673668470124 (T) = (0 -127.27405781969442) / Math.Sqrt((771.8176221127962 / (299)) + (19.13181143547263 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13217957792787471 = (146.65944080435176 - 127.27405781969442) / 146.65944080435176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: 32767) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 126.96154189048043 < 193.37623259521868. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.39077208823466 (T) = (0 -129.6070494933967) / Math.Sqrt((1003.419245934484 / (299)) + (23.0337561696346 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12329301131502993 = (147.8339412895553 - 129.6070494933967) / 147.8339412895553 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: -1.7976931348623157e+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.094864040845121 < 1.5460605008588288. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.53619134874962 (T) = (0 -1104.186097685545) / Math.Sqrt((52430.42875343844 / (299)) + (263.86313971829117 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09400774303992943 = (1218.7588681943994 - 1104.186097685545) / 1218.7588681943994 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 82.69791438650515 < 103.4624290302042. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.042572528515421 (T) = (0 -76.99919986999105) / Math.Sqrt((187.6363202772548 / (299)) + (19.375873133440713 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10384095285785734 = (85.92135527230576 - 76.99919986999105) / 85.92135527230576 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.14075855980286 < 171.60789471011074. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.624620306328167 (T) = (0 -111.50337771244229) / Math.Sqrt((831.3272555740577 / (299)) + (4.151552543939116 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13866367153946044 = (129.45393573696293 - 111.50337771244229) / 129.45393573696293 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.49800035055129 < 73.91816619905757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.352743823221582 (T) = (0 -55.20825449468958) / Math.Sqrt((107.9527577015384 / (299)) + (2.4812259140243897 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10665641925003519 = (61.79957597987335 - 55.20825449468958) / 61.79957597987335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: -3.4028235E+38) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 929.8908185156358 < 1.304376585291099. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.125402949869786 (T) = (0 -939.9505536859816) / Math.Sqrt((33965.35058583001 / (299)) + (411.26002780925796 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09651470314216237 = (1040.360653300019 - 939.9505536859816) / 1040.360653300019 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: -32768) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 131.61018764443227 < 202.87362886597688. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.996961982976561 (T) = (0 -134.32389586433578) / Math.Sqrt((1128.9349206296572 / (299)) + (23.80843004569346 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13235108645441043 = (154.81365073740497 - 134.32389586433578) / 154.81365073740497 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 9223372036854775807) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 308.91175156067777 < 501.90638725133374. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.307716915859997 (T) = (0 -309.22943964138705) / Math.Sqrt((7819.268727339817 / (299)) + (35.31865152567838 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1708271615302245 = (372.9372517942879 - 309.22943964138705) / 372.9372517942879 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.21051135269421 < 159.52573696518192. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.18800774643352 (T) = (0 -108.01561296956764) / Math.Sqrt((601.4754376996518 / (299)) + (15.20292980118754 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1354524747715178 = (124.93889556970431 - 108.01561296956764) / 124.93889556970431 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: 1.7976931348623157e+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0808938048783336 < 1.5366069352029355. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.10749452135961 (T) = (0 -1089.803935515129) / Math.Sqrt((66830.37547623974 / (299)) + (251.36798026185915 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10098863310322582 = (1212.2248679423672 - 1089.803935515129) / 1212.2248679423672 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 54.78679947354776 < 76.61981758719016. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.053013506791022 (T) = (0 -55.400114552563444) / Math.Sqrt((115.40083956349976 / (299)) + (8.071831984092988 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10632585811398507 = (61.99140375220741 - 55.400114552563444) / 61.99140375220741 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 65535) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 117.35807493428584 < 175.96676159134665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.8225574767492105 (T) = (0 -119.91911653535449) / Math.Sqrt((847.8409671145591 / (299)) + (12.299935463582596 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10235031764622436 = (133.59233439587268 - 119.91911653535449) / 133.59233439587268 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.19288520131444 < 165.60077008085574. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.809917798117214 (T) = (0 -109.2051359208117) / Math.Sqrt((806.8902243823461 / (299)) + (7.265911027981147 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.11955515173049826 = (124.03404498924878 - 109.2051359208117) / 124.03404498924878 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: FFFFFFFFFFFFFFFF) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 189.271697355012 < 288.686946344875. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.664069572500487 (T) = (0 -190.0891913713408) / Math.Sqrt((1831.2148914418185 / (299)) + (24.269152081073923 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1357966633876538 = (219.9588723141076 - 190.0891913713408) / 219.9588723141076 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 312.28495248354534 < 516.3821593602387. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.737649856953455 (T) = (0 -314.7564969318696) / Math.Sqrt((8195.809086228042 / (299)) + (26.470937693543334 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17608989554467888 = (382.0277178660796 - 314.7564969318696) / 382.0277178660796 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value: 127) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.02880220965936 < 142.73835709484896. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.380649184231874 (T) = (0 -96.22570469700808) / Math.Sqrt((495.143517006199 / (299)) + (11.633331387667576 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12836852919445516 = (110.3972354372177 - 96.22570469700808) / 110.3972354372177 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDateTimeOffset(value: 12/30/2017 3:45:22 AM -08:00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 145.9376067993979 < 216.03467670316104. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.437628069029884 (T) = (0 -147.8393839106129) / Math.Sqrt((995.543098974297 / (299)) + (30.77166821777524 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14214317772900556 = (172.33573257509266 - 147.8393839106129) / 172.33573257509266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 421.5536070650569 < 593.619269724525. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.36779460718884 (T) = (0 -430.4267059672735) / Math.Sqrt((7235.413339868044 / (299)) + (125.29800984612443 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09087314666732711 = (473.4506569566363 - 430.4267059672735) / 473.4506569566363 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDecimal(value: 123456.789) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 684.7755081659029 < 909.1486098849667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.741563236365751 (T) = (0 -642.299143465764) / Math.Sqrt((17197.63616248328 / (299)) + (150.33939656499376 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10532628244021681 = (717.9143981312325 - 642.299143465764) / 717.9143981312325 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value: 255) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.20413095961372 < 123.68370855039662. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.263303906851027 (T) = (0 -84.60952772541205) / Math.Sqrt((394.4325010702322 / (299)) + (9.424855611889551 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11779832134546818 = (95.90723954918357 - 84.60952772541205) / 95.90723954918357 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in Microsoft.Extensions.Logging.ScopesOverheadBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FilteredByLevel_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20False).html>) 141.55 ns 108.55 ns 0.77 0.14 False
[FilteredByLevel_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20True).html>) 647.41 ns 547.69 ns 0.85 0.08 False
[NotFiltered_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20True).html>) 374.53 ns 281.29 ns 0.75 0.12 False
[NotFiltered - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20True).html>) 299.91 ns 230.53 ns 0.77 0.09 False
[FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20False).html>) 98.18 ns 71.78 ns 0.73 0.22 False
[FilteredByLevel_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20True).html>) 160.12 ns 121.44 ns 0.76 0.24 False
[NotFiltered - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20True).html>) 299.94 ns 229.68 ns 0.77 0.14 False
[FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20True).html>) 101.08 ns 73.44 ns 0.73 0.25 False
[NotFiltered - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20False).html>) 302.88 ns 236.32 ns 0.78 0.12 False
[FilteredByLevel_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20False).html>) 145.10 ns 106.11 ns 0.73 0.15 False
[NotFiltered_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20False).html>) 344.04 ns 266.02 ns 0.77 0.12 False
[NotFiltered_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20False).html>) 341.82 ns 267.21 ns 0.78 0.12 False
[NotFiltered - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20False).html>) 298.76 ns 221.80 ns 0.74 0.12 False
[FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20False).html>) 98.49 ns 71.95 ns 0.73 0.18 False
[FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20True).html>) 99.86 ns 72.58 ns 0.73 0.20 False
[NotFiltered_InsideScope - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger%3a%20True%2c%20CaptureScopes%3a%20True).html>) 878.32 ns 726.42 ns 0.83 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 108.54525427626798 < 135.19123196539655. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.561942707623544 (T) = (0 -109.65474435336087) / Math.Sqrt((83.90371996060907 / (299)) + (16.018054681637086 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13922885508651364 = (127.39128745351002 - 109.65474435336087) / 127.39128745351002 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 547.6872355385398 < 627.6308877158322. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.344179465377273 (T) = (0 -556.7800413217323) / Math.Sqrt((961.5162658353514 / (299)) + (125.78422688125568 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09271071806109647 = (613.6742188024939 - 556.7800413217323) / 613.6742188024939 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 281.28828997805186 < 345.3739453281855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.578541739725026 (T) = (0 -286.3809807228261) / Math.Sqrt((761.3770024267798 / (299)) + (66.52965910237238 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10061455518261259 = (318.4185183038773 - 286.3809807228261) / 318.4185183038773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger: False, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 230.52931430727992 < 287.50234988585925. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.676515309201424 (T) = (0 -234.24966066616454) / Math.Sqrt((607.616043735556 / (299)) + (34.479310665726786 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09820347285424705 = (259.7588853081754 - 234.24966066616454) / 259.7588853081754 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.77623809113126 < 94.20709920611888. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.422352461566001 (T) = (0 -72.97891835137743) / Math.Sqrt((106.55824794183454 / (299)) + (2.6621539817516697 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11158425347921105 = (82.14500771421179 - 72.97891835137743) / 82.14500771421179 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.44160604049151 < 152.6350911735254. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.745435556752362 (T) = (0 -125.80864968204139) / Math.Sqrt((237.49710417302407 / (299)) + (22.229771892487303 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08527257854502678 = (137.53676421105763 - 125.80864968204139) / 137.53676421105763 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger: True, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 229.6812029735644 < 284.7492678809185. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.97284841931378 (T) = (0 -232.4965911482805) / Math.Sqrt((572.7987101045669 / (299)) + (24.822509679313924 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10612958121049057 = (260.10100151108065 - 232.4965911482805) / 260.10100151108065 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.44011436140696 < 93.27515558883714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.610786615250701 (T) = (0 -73.5579858467361) / Math.Sqrt((112.56852206132353 / (299)) + (8.95648093318967 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10362707344111369 = (82.06181118066576 - 73.5579858467361) / 82.06181118066576 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger: False, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 236.31978876577415 < 287.63299953780404. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.962821219901047 (T) = (0 -234.42391535794727) / Math.Sqrt((585.8662822822666 / (299)) + (49.499186981028224 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09716984199463133 = (259.65450232174595 - 234.42391535794727) / 259.65450232174595 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.10830343122095 < 135.13884009292804. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 27.395037226148112 (T) = (0 -109.26643408721672) / Math.Sqrt((85.99860738282366 / (299)) + (8.718470626633483 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14344210615779324 = (127.56456378807893 - 109.26643408721672) / 127.56456378807893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 266.0185914065652 < 326.57999698785136. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.3933015701643 (T) = (0 -271.1324496360433) / Math.Sqrt((483.89360222847796 / (299)) + (55.04560304818821 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12252613682782096 = (308.9920520890106 - 271.1324496360433) / 308.9920520890106 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 267.2143577001129 < 329.73856231684806. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 22.37920611707043 (T) = (0 -270.3093953200911) / Math.Sqrt((635.5915601258357 / (299)) + (49.935566191112656 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12602705997520441 = (309.2880602372221 - 270.3093953200911) / 309.2880602372221 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered(HasISupportLoggingScopeLogger: True, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 221.80485030850554 < 283.965044146536. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.291067767687483 (T) = (0 -233.7953710835499) / Math.Sqrt((632.4584431300312 / (299)) + (29.88300451761434 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10185671166710511 = (260.3096567336304 - 233.7953710835499) / 260.3096567336304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.94842500973303 < 93.35362271436722. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.970150005989876 (T) = (0 -73.70022915198795) / Math.Sqrt((106.93280754153432 / (299)) + (6.51068161253409 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10056409411167233 = (81.94050145151581 - 73.70022915198795) / 81.94050145151581 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 72.57832154482168 < 95.18577798547273. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.228547641644107 (T) = (0 -74.0084384371729) / Math.Sqrt((104.57209071160906 / (299)) + (13.350931368896223 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.0961535993666169 = (81.88165421172275 - 74.0084384371729) / 81.88165421172275 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.NotFiltered_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 726.4194148685018 < 833.7183664668713. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.045512433405264 (T) = (0 -730.443617209241) / Math.Sqrt((1905.0373293687207 / (299)) + (302.39979502613716 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09767348551978959 = (809.5114190787318 - 730.443617209241) / 809.5114190787318 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToStream.html>) 31.50 μs 25.50 μs 0.81 0.01 False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToUtf8Bytes.html>) 25.88 μs 20.74 μs 0.80 0.01 False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeObjectProperty.html>) 34.11 μs 27.80 μs 0.81 0.01 False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(Location).SerializeToString.html>) 28.05 μs 22.34 μs 0.80 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Location&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.497225425175394 < 29.765162822601408. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.566700313704793 (T) = (0 -25852.263791581176) / Math.Sqrt((4998530.450267015 / (299)) + (57785.01833907247 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.051694866778283034 = (27261.54576824043 - 25852.263791581176) / 27261.54576824043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.738751526292337 < 24.45970026538611. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.590732745542834 (T) = (0 -20796.962530068326) / Math.Sqrt((4733228.936172375 / (299)) + (30514.533687576306 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05572406320667721 = (22024.24282958323 - 20796.962530068326) / 22024.24282958323 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 27.801611845874703 < 32.39648789539469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.857917065335034 (T) = (0 -28077.366179089615) / Math.Sqrt((5667244.267972627 / (299)) + (73876.31879491993 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05218834255846269 = (29623.360251634673 - 28077.366179089615) / 29623.360251634673 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.336302632296782 < 26.522062056535756. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.123879038236291 (T) = (0 -22512.831629792956) / Math.Sqrt((4946876.547285089 / (299)) + (33924.64833740538 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.05563341063832334 = (23839.081013031177 - 22512.831629792956) / 23839.081013031177 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[AddThenRemove_SlidingExpiration - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_SlidingExpiration.html>) 310.11 μs 269.15 μs 0.87 0.54 False
[TryGetValueHit - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueHit.html>) 479.52 ns 377.55 ns 0.79 0.15 False
[GetHit - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetHit.html>) 504.59 ns 409.26 ns 0.81 0.14 False
[AddThenRemove_AbsoluteExpiration - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_AbsoluteExpiration.html>) 323.83 μs 234.48 μs 0.72 0.49 False
[TryGetValueMiss - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueMiss.html>) 318.19 ns 250.07 ns 0.79 0.20 False
[GetMiss - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetMiss.html>) 332.01 ns 255.82 ns 0.77 0.26 False
[SetOverride - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.SetOverride.html>) 1.38 μs 1.17 μs 0.84 0.08 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_SlidingExpiration ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 269.1480499005305 < 275.6553085434098. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.576039684014561 (T) = (0 -248919.31634381675) / Math.Sqrt((1049010857.7733797 / (299)) + (464704501.6109044 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09467834751692572 = (274951.24595892784 - 248919.31634381675) / 274951.24595892784 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueHit ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 377.5474673508627 < 454.847839187507. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.918519206036876 (T) = (0 -369.4138217364454) / Math.Sqrt((3558.3274252282913 / (299)) + (86.05000725219725 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16517600194572493 = (442.5050341119068 - 369.4138217364454) / 442.5050341119068 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetHit ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 409.2606536747717 < 478.6100871980925. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.844333976072903 (T) = (0 -389.7935056930258) / Math.Sqrt((3148.237309140475 / (299)) + (112.06247593586362 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1655362354018588 = (467.1185523325168 - 389.7935056930258) / 467.1185523325168 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_AbsoluteExpiration ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 234.47572449052814 < 282.07647967844963. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.640231260813806 (T) = (0 -257669.6815104194) / Math.Sqrt((975716410.2357409 / (299)) + (422890061.1672625 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07812709286484772 = (279506.7297412651 - 257669.6815104194) / 279506.7297412651 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueMiss ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 250.06560193226227 < 310.6825710718382. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.37062490865711 (T) = (0 -256.5468280187967) / Math.Sqrt((2403.7055140021007 / (299)) + (41.73128020727832 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.18309778030501372 = (314.04839139081514 - 256.5468280187967) / 314.04839139081514 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetMiss ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 255.8191331886808 < 325.60413230259155. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.512179672471344 (T) = (0 -274.63460939727923) / Math.Sqrt((2251.335919074315 / (299)) + (74.30988075004163 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18185259514454294 = (335.67864148612585 - 274.63460939727923) / 335.67864148612585 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.SetOverride ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1657802845138516 < 1.3336605605092429. IsChangePoint: Marked as a change because one of 4/27/2022 1:24:17 PM, 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.39213119587673 (T) = (0 -1182.3487964083895) / Math.Sqrt((16628.990006215947 / (299)) + (628.3093949621065 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12357590850923252 = (1349.0601272692704 - 1182.3487964083895) / 1349.0601272692704 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(IndexViewModel).JsonNet.html>) 964.82 μs 753.76 μs 0.78 0.01 False
[DataContractJsonSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.JsonToStream(IndexViewModel).DataContractJsonSerializer.html>) 2.25 ms 1.78 ms 0.79 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;IndexViewModel&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>.JsonNet_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 753.7559134199136 < 917.7268704824437. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.938190692704929 (T) = (0 -758500.3348219284) / Math.Sqrt((6632663830.787587 / (299)) + (37309055.139181994 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07540795080456489 = (820362.1645697289 - 758500.3348219284) / 820362.1645697289 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>.DataContractJsonSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.778528827895981 < 2.146328070557506. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.864047217998303 (T) = (0 -1792536.8949437526) / Math.Sqrt((35341080014.271515 / (299)) + (153259330.8903264 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07314680157065376 = (1934003.0308806202 - 1792536.8949437526) / 1934003.0308806202 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%202147483647).html>) 356.06 ns 221.47 ns 0.62 0.13 False
[FormatterDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value%3a%20-1.7976931348623157E%2b308).html>) 6.39 μs 5.10 μs 0.80 0.04 False
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%200).html>) 77.04 ns 49.23 ns 0.64 0.20 False
[FormatterDecimal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value%3a%20123456.789).html>) 873.87 ns 627.82 ns 0.72 0.06 False
[FormatterInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value%3a%209223372036854775807).html>) 532.57 ns 362.82 ns 0.68 0.06 False
[FormatterDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value%3a%201.7976931348623157E%2b308).html>) 6.39 μs 5.08 μs 0.79 0.01 False
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%2012345).html>) 244.05 ns 168.89 ns 0.69 0.25 False
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%204294967295).html>) 341.93 ns 220.99 ns 0.65 0.12 False
[FormatterInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value%3a%2012345).html>) 243.20 ns 148.52 ns 0.61 0.19 False
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%204).html>) 80.43 ns 51.50 ns 0.64 0.21 False
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%20-2147483648).html>) 354.42 ns 226.30 ns 0.64 0.12 False
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%2012345).html>) 231.97 ns 142.49 ns 0.61 0.23 False
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%2012345).html>) 233.68 ns 142.42 ns 0.61 0.27 False
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%200).html>) 76.04 ns 57.74 ns 0.76 0.22 False
[FormatterDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value%3a%2012345).html>) 2.95 μs 2.24 μs 0.76 0.22 False
[FormatterDateTimeOffsetNow - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value%3a%2012%2f30%2f2017%203%3a45%3a22%20AM%20-08%3a00).html>) 808.43 ns 579.45 ns 0.72 0.06 False
[FormatterInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value%3a%20-9223372036854775808).html>) 539.54 ns 372.78 ns 0.69 0.09 False
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%2018446744073709551615).html>) 544.51 ns 384.32 ns 0.71 0.06 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 221.4724766596457 < 336.20665423179526. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.82182593894514 (T) = (0 -227.9934328484199) / Math.Sqrt((2037.4690683027718 / (299)) + (53.43913309085721 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16207290822818113 = (272.0922083642406 - 227.9934328484199) / 272.0922083642406 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: -1.7976931348623157E+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.096372727149664 < 6.070117673081226. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.757864847718954 (T) = (0 -5140.902333849764) / Math.Sqrt((325806.52157112333 / (299)) + (7334.149902037635 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.062190019523248145 = (5481.81661623637 - 5140.902333849764) / 5481.81661623637 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 49.23247236151936 < 73.28765424936235. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 28.11742977431751 (T) = (0 -50.13985893926985) / Math.Sqrt((59.001633214986114 / (299)) + (4.043351299300668 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.22548915045574258 = (64.73745199150336 - 50.13985893926985) / 64.73745199150336 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 627.8187363267313 < 835.9529588688584. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.5011421193963566 (T) = (0 -618.0553019272969) / Math.Sqrt((14537.63723394045 / (299)) + (77.84726150272965 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07904446187371912 = (671.1022154063528 - 618.0553019272969) / 671.1022154063528 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 362.8164972981449 < 508.4720291891471. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.243525759819708 (T) = (0 -364.0979669170951) / Math.Sqrt((3311.967062532869 / (299)) + (35.03206066016445 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15993623034863025 = (433.4170572172127 - 364.0979669170951) / 433.4170572172127 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 1.7976931348623157E+308) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.075519145603802 < 6.1284629997346265. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.15568013488927 (T) = (0 -5148.891438744395) / Math.Sqrt((269976.60548490746 / (299)) + (5961.5885543684435 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06977244678733753 = (5535.088077064612 - 5148.891438744395) / 5535.088077064612 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 168.8883115992302 < 233.43608560277076. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.542872554838226 (T) = (0 -155.09930563587633) / Math.Sqrt((886.9268398543912 / (299)) + (33.261017852769896 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15901878078996332 = (184.42659846978103 - 155.09930563587633) / 184.42659846978103 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 4294967295) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 220.99208759501983 < 322.864422425827. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.172164672747012 (T) = (0 -218.64327668792143) / Math.Sqrt((1663.7144973969107 / (299)) + (31.96966048288364 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1707199656693764 = (263.6543358533953 - 218.64327668792143) / 263.6543358533953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 148.52237998039888 < 230.7711581643309. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.915372224539182 (T) = (0 -153.93894354229624) / Math.Sqrt((913.4035467002144 / (299)) + (19.10160082160959 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16003372644316277 = (183.26800538126582 - 153.93894354229624) / 183.26800538126582 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 51.49944338522793 < 76.16501816519744. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.347620970094017 (T) = (0 -51.57977273253103) / Math.Sqrt((74.37876419774828 / (299)) + (5.56904798555253 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.21786080046610015 = (65.94704978764517 - 51.57977273253103) / 65.94704978764517 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 226.30186284861375 < 336.5593244714522. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.356815165741414 (T) = (0 -230.9444747867272) / Math.Sqrt((2100.373005290091 / (299)) + (38.552291970913764 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1472301181960836 = (270.8168753546926 - 230.9444747867272) / 270.8168753546926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 142.49236048151508 < 220.63678972778206. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.34234673076441 (T) = (0 -147.21495590856722) / Math.Sqrt((750.383988537404 / (299)) + (28.76430223159911 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1620004384007101 = (175.67426363280327 - 147.21495590856722) / 175.67426363280327 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 142.41652750984792 < 224.70735494749607. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.898103991172498 (T) = (0 -146.607017935369) / Math.Sqrt((808.3800781851795 / (299)) + (22.88595467914995 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16914731043444964 = (176.4536840002639 - 146.607017935369) / 176.4536840002639 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.736863369188946 < 72.0203574209697. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.94241729838256 (T) = (0 -49.99822705852897) / Math.Sqrt((58.44833741870773 / (299)) + (6.518873570187747 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.21789537653086527 = (63.92779886245247 - 49.99822705852897) / 63.92779886245247 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.2417137753401835 < 2.747048484637416. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.287761226371343 (T) = (0 -2275.9665543205765) / Math.Sqrt((63653.46604292652 / (299)) + (5243.522264560571 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07333459495077853 = (2456.0823593060372 - 2275.9665543205765) / 2456.0823593060372 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 579.4473687474645 < 774.8375997541405. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.122807504497162 (T) = (0 -575.0204658028296) / Math.Sqrt((11185.803214351761 / (299)) + (147.13718441493694 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10028139866878387 = (639.1114565732375 - 575.0204658028296) / 639.1114565732375 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: -9223372036854775808) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 372.7830065663328 < 510.30520195167577. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.214883982897486 (T) = (0 -369.21894925542483) / Math.Sqrt((3485.7457328174214 / (299)) + (53.730319476910616 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14216993265379343 = (430.4103613407315 - 369.21894925542483) / 430.4103613407315 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 18446744073709551615) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 384.3156301085326 < 517.6686327340021. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.715841283454523 (T) = (0 -371.9157157795712) / Math.Sqrt((3499.30691722438 / (299)) + (38.8641270086801 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15729384486244288 = (441.33499383170215 - 371.9157157795712) / 441.33499383170215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Random

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Next_long_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_long_long.html>) 618.09 ns 464.07 ns 0.75 0.08 False
[NextBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextBytes.html>) 57.62 μs 41.40 μs 0.72 0.13 False
[Next_long_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_long_unseeded.html>) 201.88 ns 136.35 ns 0.68 0.24 False
[NextBytes_span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextBytes_span.html>) 57.58 μs 41.24 μs 0.72 0.14 False
[NextBytes_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextBytes_unseeded.html>) 7.78 μs 4.69 μs 0.60 0.20 False
[Next_int_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_int_unseeded.html>) 231.46 ns 140.59 ns 0.61 0.16 False
[NextBytes_span_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextBytes_span_unseeded.html>) 7.77 μs 4.65 μs 0.60 0.17 False
[Next_int_int_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_int_int_unseeded.html>) 237.26 ns 157.89 ns 0.67 0.23 False
[ctor_seeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.ctor_seeded.html>) 7.19 μs 4.74 μs 0.66 0.12 False
[NextDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextDouble.html>) 93.33 ns 73.46 ns 0.79 0.30 False
[Next_long_long_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_long_long_unseeded.html>) 228.09 ns 158.71 ns 0.70 0.17 False
[NextDouble_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextDouble_unseeded.html>) 75.07 ns 55.90 ns 0.74 0.38 False
[Next_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_int.html>) 105.10 ns 79.13 ns 0.75 0.13 False
[Next_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_unseeded.html>) 76.08 ns 57.76 ns 0.76 0.30 False
[NextSingle_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextSingle_unseeded.html>) 78.47 ns 56.48 ns 0.72 0.29 False
[Next_int_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_int_int.html>) 118.91 ns 87.02 ns 0.73 0.16 False
[Next - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next.html>) 78.10 ns 64.88 ns 0.83 0.22 False
[Next_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.Next_long.html>) 572.19 ns 426.34 ns 0.75 0.04 False
[NextSingle - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Random.NextSingle.html>) 90.96 ns 77.54 ns 0.85 0.19 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Random*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Random.Next_long_long ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 464.06530105691564 < 581.3921534797695. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.26918566300929 (T) = (0 -459.40083739242306) / Math.Sqrt((2752.9847400596664 / (299)) + (42.601528944529186 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1222676815372204 = (523.3951487590166 - 459.40083739242306) / 523.3951487590166 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextBytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.404281453500204 < 54.63927996456094. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.722567584950927 (T) = (0 -41640.13160452164) / Math.Sqrt((42893003.931651555 / (299)) + (733024.324851065 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10022241084632728 = (46278.24932124413 - 41640.13160452164) / 46278.24932124413 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_long_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 136.34665472448225 < 191.44126478459566. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.30097830490202 (T) = (0 -139.8844400574274) / Math.Sqrt((709.3501290785412 / (299)) + (23.094069072588457 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11880045417901115 = (158.74320489702592 - 139.8844400574274) / 158.74320489702592 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextBytes_span ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.2409129287599 < 54.83007293008569. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.469338678896271 (T) = (0 -41454.908369056655) / Math.Sqrt((44249982.58741152 / (299)) + (361418.6623425178 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10571429328418437 = (46355.3292395739 - 41454.908369056655) / 46355.3292395739 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextBytes_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.687663970440631 < 7.315769932008113. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.324600028901004 (T) = (0 -4830.98278008592) / Math.Sqrt((1729032.6347327963 / (299)) + (78908.75154187737 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.113929358962577 = (5452.141800375806 - 4830.98278008592) / 5452.141800375806 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_int_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 140.5851956583377 < 204.3925445858993. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.89329086893807 (T) = (0 -144.32402968868476) / Math.Sqrt((715.7948370327092 / (299)) + (24.466042323396703 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1309921916103107 = (166.07909422140142 - 144.32402968868476) / 166.07909422140142 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextBytes_span_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.647772293776057 < 7.348900097319384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.25538944675224 (T) = (0 -4782.934378643215) / Math.Sqrt((2047184.171606201 / (299)) + (97285.7675082847 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12322522095654113 = (5455.14594279421 - 4782.934378643215) / 5455.14594279421 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_int_int_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 157.89483826120622 < 222.72153919732293. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.882975107635204 (T) = (0 -155.87409871097026) / Math.Sqrt((1089.3978130177022 / (299)) + (14.724819928896816 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1310142718220363 = (179.37475111104249 - 155.87409871097026) / 179.37475111104249 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.ctor_seeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.736874992389651 < 6.840739378970777. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.462394383259268 (T) = (0 -4795.310962821927) / Math.Sqrt((987345.1886970348 / (299)) + (13090.38582047291 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12458216812380063 = (5477.739644101829 - 4795.310962821927) / 5477.739644101829 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextDouble ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.46184298971602 < 85.78832505565822. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.782911104055904 (T) = (0 -75.52214187183638) / Math.Sqrt((43.56786719265333 / (299)) + (5.44442154568036 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07140804466196536 = (81.3297395456588 - 75.52214187183638) / 81.3297395456588 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_long_long_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 158.70797326159837 < 226.31662995328335. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.04896175041689 (T) = (0 -154.98474586647555) / Math.Sqrt((911.0668080916817 / (299)) + (22.357807816875685 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12612116516237296 = (177.35267143215893 - 154.98474586647555) / 177.35267143215893 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextDouble_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 55.895261581646515 < 72.28452822436903. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.66904868087158 (T) = (0 -56.84974328329786) / Math.Sqrt((76.2177233348238 / (299)) + (6.904849462091015 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07660657913827794 = (61.566112557142745 - 56.84974328329786) / 61.566112557142745 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_int ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.13178483327714 < 96.01502704620779. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.437690856186315 (T) = (0 -80.19927010932437) / Math.Sqrt((45.56506497686697 / (299)) + (4.054286724929148 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10306756030383557 = (89.41506245051394 - 80.19927010932437) / 89.41506245051394 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 57.7600979481654 < 72.62870513765246. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.926344476934867 (T) = (0 -57.67226480040826) / Math.Sqrt((69.63761765861356 / (299)) + (4.184303094043896 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07921879716129827 = (62.63405966869094 - 57.67226480040826) / 62.63405966869094 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextSingle_unseeded ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 56.484042362105015 < 72.9797142602222. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.40474167058053 (T) = (0 -57.48262885867537) / Math.Sqrt((73.5745207276411 / (299)) + (5.2704068183455055 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08711311529900923 = (62.96796440174882 - 57.48262885867537) / 62.96796440174882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_int_int ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 87.02172944326095 < 112.6884060052546. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.066992571254612 (T) = (0 -89.34738537289923) / Math.Sqrt((123.61471887309249 / (299)) + (4.383484409379849 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09942405532484275 = (99.21138344987365 - 89.34738537289923) / 99.21138344987365 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 64.88008951937324 < 74.97744702810961. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.238180093581667 (T) = (0 -65.71128311120768) / Math.Sqrt((32.763029595888035 / (299)) + (4.7118181425949865 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.058271193347183496 = (69.77728901037345 - 65.71128311120768) / 69.77728901037345 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.Next_long ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 426.33627245382144 < 546.2476474028141. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.94152143869987 (T) = (0 -431.6580761021237) / Math.Sqrt((2259.4896373396805 / (299)) + (58.64558818814126 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1141479274789987 = (487.280088281207 - 431.6580761021237) / 487.280088281207 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Random.NextSingle ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.53841512923452 < 87.59847672421499. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.77595775523694 (T) = (0 -75.11238201719087) / Math.Sqrt((38.77040368154148 / (299)) + (4.608726508227074 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09323971960143891 = (82.83598613756622 - 75.11238201719087) / 82.83598613756622 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Base64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteByteArrayAsBase64_HeavyEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes%3a%201000).html>) 20.77 μs 12.82 μs 0.62 0.06 False
[WriteByteArrayAsBase64_NoEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes%3a%20100).html>) 3.05 μs 2.01 μs 0.66 0.06 False
[WriteByteArrayAsBase64_HeavyEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes%3a%20100).html>) 3.06 μs 2.01 μs 0.66 0.07 False
[WriteByteArrayAsBase64_NoEscaping - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes%3a%201000).html>) 20.75 μs 12.85 μs 0.62 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Base64*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.824511107690203 < 19.727566651213525. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.900419760877763 (T) = (0 -12795.916051026501) / Math.Sqrt((12334058.609517364 / (299)) + (41035.32610830819 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11230141177799989 = (14414.70812368402 - 12795.916051026501) / 14414.70812368402 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.012894311043237 < 2.871485892002302. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.996308283625627 (T) = (0 -2013.6894396659739) / Math.Sqrt((186549.7439884028 / (299)) + (1091.385514143287 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1118632622108197 = (2267.3191570462536 - 2013.6894396659739) / 2267.3191570462536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.0065220244215936 < 2.895836426810313. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.724461768075534 (T) = (0 -2011.7327269511698) / Math.Sqrt((211891.44955898784 / (299)) + (920.8022932925404 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11519515854819495 = (2273.6457043456944 - 2011.7327269511698) / 2273.6457043456944 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.846547625889436 < 19.716949753722016. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.237817380754143 (T) = (0 -12768.251081393782) / Math.Sqrt((12228804.448049031 / (299)) + (18217.66955167357 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.115838420997785 = (14441.083377319877 - 12768.251081393782) / 14441.083377319877 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in GuardedDevirtualization.TwoClassVirtual

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.40).html>) 23.38 ns 17.20 ns 0.74 0.07 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.60).html>) 23.52 ns 17.22 ns 0.73 0.03 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.70).html>) 23.39 ns 17.25 ns 0.74 0.08 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%201.00).html>) 23.39 ns 17.18 ns 0.73 0.06 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.50).html>) 23.43 ns 17.56 ns 0.75 0.07 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.30).html>) 23.39 ns 17.16 ns 0.73 0.04 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.80).html>) 23.39 ns 17.20 ns 0.74 0.09 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.20).html>) 23.42 ns 17.23 ns 0.74 0.07 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.00).html>) 23.45 ns 17.17 ns 0.73 0.08 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.90).html>) 23.38 ns 17.14 ns 0.73 0.06 False
[Call - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/GuardedDevirtualization.TwoClassVirtual.Call(testInput%3a%20pB%20%3d%200.10).html>) 23.39 ns 17.19 ns 0.73 0.06 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'GuardedDevirtualization.TwoClassVirtual*'
### Payloads [Baseline]() [Compare]() ### Histogram #### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.40) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.199289372246696 < 22.27392517470862. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.93305981245632 (T) = (0 -17.346040655234344) / Math.Sqrt((4.417747670638802 / (299)) + (0.09822608010415335 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12316359526174905 = (19.782527916838035 - 17.346040655234344) / 19.782527916838035 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.60) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.216411885771905 < 22.206896775516384. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.904929576892496 (T) = (0 -17.288870123946488) / Math.Sqrt((4.048795591751973 / (299)) + (0.08647291693028088 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12398922753008378 = (19.73591041032571 - 17.288870123946488) / 19.73591041032571 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.70) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.24744030865657 < 22.213467931432938. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.083386879030016 (T) = (0 -17.403654126742943) / Math.Sqrt((4.117895972882379 / (299)) + (0.26986224319208135 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1182866165048127 = (19.738448403440774 - 17.403654126742943) / 19.738448403440774 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 1.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.179960626866258 < 22.221515339800312. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.047093685960505 (T) = (0 -17.29561426836787) / Math.Sqrt((4.543878067363831 / (299)) + (0.09818196709524234 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12550095694981347 = (19.777739502197825 - 17.29561426836787) / 19.777739502197825 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.50) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.55653026183788 < 22.211686393398665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.416652775770128 (T) = (0 -17.286072097612458) / Math.Sqrt((4.686270137722221 / (299)) + (0.051845243752867545 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12642134215515843 = (19.787653856217123 - 17.286072097612458) / 19.787653856217123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.30) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.158141205700172 < 22.237412889867162. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.363797084111418 (T) = (0 -17.260722407231114) / Math.Sqrt((4.367997859101244 / (299)) + (0.035869286696017605 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12720431649686428 = (19.776360875149884 - 17.260722407231114) / 19.776360875149884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.80) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.19774575671853 < 22.20624370910176. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.84689166244385 (T) = (0 -17.303978354069596) / Math.Sqrt((4.300547284317834 / (299)) + (0.08350625734702766 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.126262552448672 = (19.80455158762446 - 17.303978354069596) / 19.80455158762446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.20) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.230260113285933 < 22.225800770829377. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.856370510792683 (T) = (0 -17.29598793335709) / Math.Sqrt((4.224051098621236 / (299)) + (0.16645066283249346 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1247744394288402 = (19.761749099363566 - 17.29598793335709) / 19.761749099363566 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.00) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.165277839029766 < 22.208889865301092. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.78351550757753 (T) = (0 -17.297309050652025) / Math.Sqrt((4.443447689520908 / (299)) + (0.1591953123449712 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12624680284898174 = (19.796561668732163 - 17.297309050652025) / 19.796561668732163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.90) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.14112648940058 < 22.207201054765466. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 19.529593895276932 (T) = (0 -17.307345034042683) / Math.Sqrt((4.58284387828732 / (299)) + (0.060158383839718714 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12626530843058748 = (19.80846726247647 - 17.307345034042683) / 19.80846726247647 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 17.186776957818758 < 22.21593476867779. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.384885308120847 (T) = (0 -17.272432146166093) / Math.Sqrt((4.263695473845263 / (299)) + (0.05116978472564679 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12698652137230887 = (19.78484017602684 - 17.272432146166093) / 19.78484017602684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.ContainsKeyTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).IDictionary(Size%3a%20512).html>) 176.63 μs 110.29 μs 0.62 0.04 False
[ConcurrentDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).ConcurrentDictionary(Size%3a%20512).html>) 154.03 μs 107.10 μs 0.70 0.09 False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).SortedList(Size%3a%20512).html>) 1.54 ms 1.31 ms 0.85 0.12 False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).Dictionary(Size%3a%20512).html>) 172.17 μs 109.32 μs 0.63 0.06 False
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).ImmutableDictionary(Size%3a%20512).html>) 298.01 μs 215.43 μs 0.72 0.03 False
[ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).ImmutableSortedDictionary(Size%3a%20512).html>) 1.64 ms 1.36 ms 0.83 0.09 False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsKeyTrue(String%2c%20String).SortedDictionary(Size%3a%20512).html>) 1.72 ms 1.41 ms 0.82 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<String, String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.28998301056336 < 165.84568686111106. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.734599049641675 (T) = (0 -112956.122794635) / Math.Sqrt((545274872.2894236 / (299)) + (5378692.759136549 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.144180402734151 = (131985.90351927484 - 112956.122794635) / 131985.90351927484 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.ConcurrentDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 107.10464473536034 < 145.4627540795237. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.227727671470413 (T) = (0 -106965.14325619787) / Math.Sqrt((335321104.7799025 / (299)) + (4585198.8643459845 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10331313578243803 = (119289.29431740294 - 106965.14325619787) / 119289.29431740294 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.SortedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3122348173363094 < 1.4611779749266824. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.627589108254623 (T) = (0 -1297855.2166144124) / Math.Sqrt((8560644154.713725 / (299)) + (973080909.8064293 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07550632705807273 = (1403855.16375074 - 1297855.2166144124) / 1403855.16375074 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.31675789835165 < 163.9031800769258. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.250128857904524 (T) = (0 -110390.60324175814) / Math.Sqrt((552454898.514954 / (299)) + (4795447.59452697 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1521750427381586 = (130204.4747518151 - 110390.60324175814) / 130204.4747518151 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 215.42576297418336 < 283.22401497363705. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.850945163211899 (T) = (0 -216786.56501000462) / Math.Sqrt((976197054.1864442 / (299)) + (10836448.900352186 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08515661357838811 = (236965.76728609265 - 216786.56501000462) / 236965.76728609265 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.ImmutableSortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.3569519758680553 < 1.50960472890625. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.219242017566932 (T) = (0 -1330001.6706400563) / Math.Sqrt((9103915933.36429 / (299)) + (654334434.5146798 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0648924317075592 = (1422298.04969787 - 1330001.6706400563) / 1422298.04969787 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyTrue<String, String>.SortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4055231552083336 < 1.6077036195271992. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.291410990425987 (T) = (0 -1416889.5854932086) / Math.Sqrt((10296804988.870157 / (299)) + (756375423.9588467 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.077917026513934 = (1536618.3155258314 - 1416889.5854932086) / 1536618.3155258314 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteAsyncThenReadAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync.html>) 982.67 ns 794.94 ns 0.81 0.06 False
[ReadAsyncThenWriteAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.ReadAsyncThenWriteAsync.html>) 1.66 μs 1.47 μs 0.88 0.06 False
[TryWriteThenTryRead - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead.html>) 508.58 ns 408.57 ns 0.80 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Channels.Tests.UnboundedChannelPerfTests.WriteAsyncThenReadAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 794.9417462461333 < 927.2408642444469. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 32.708756432500834 (T) = (0 -811.5013684788908) / Math.Sqrt((1437.755459038099 / (299)) + (227.8293423933579 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10721443908990685 = (908.9544051895929 - 811.5013684788908) / 908.9544051895929 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.ReadAsyncThenWriteAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4667404900469487 < 1.6197940403435875. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 27.554633812844596 (T) = (0 -1458.6471280345954) / Math.Sqrt((3725.454694995428 / (299)) + (610.9193271213979 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0836782085508638 = (1591.850310279959 - 1458.6471280345954) / 1591.850310279959 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 408.56696316936376 < 480.4020136903972. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.97204658648446 (T) = (0 -413.20015634329246) / Math.Sqrt((1011.4265784510654 / (299)) + (78.84232202988402 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08248617016373479 = (450.3476055690954 - 413.20015634329246) / 450.3476055690954 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Threading.Tests.Perf_Lock

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReaderWriterLockSlimPerf - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Threading.Tests.Perf_Lock.ReaderWriterLockSlimPerf.html>) 329.85 ns 262.87 ns 0.80 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Lock*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_Lock.ReaderWriterLockSlimPerf ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 262.8716119251929 < 314.5159262242637. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.037711502448932 (T) = (0 -263.43641809891847) / Math.Sqrt((744.320732672926 / (299)) + (39.5652419901268 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08143349720440127 = (286.79079554628487 - 263.43641809891847) / 286.79079554628487 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in Benchstone.BenchF.NewtR

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.BenchF.NewtR.Test.html>) 5.11 secs 3.56 secs 0.70 0.14 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.NewtR*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.BenchF.NewtR.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.5569835703333337 < 4.856133905850476. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.293782483297814 (T) = (0 -3605195126.209175) / Math.Sqrt((3.4557612802032275E+17 / (299)) + (18887266671786912 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12471176444232833 = (4118866197.1586995 - 3605195126.209175) / 4118866197.1586995 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Collections.ContainsTrue<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).ICollection(Size%3a%20512).html>) 6.72 ms 5.29 ms 0.79 0.11 False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).List(Size%3a%20512).html>) 6.79 ms 5.35 ms 0.79 0.09 False
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).LinkedList(Size%3a%20512).html>) 6.91 ms 5.68 ms 0.82 0.15 False
[ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).ImmutableHashSet(Size%3a%20512).html>) 291.90 μs 218.69 μs 0.75 0.02 False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).ImmutableArray(Size%3a%20512).html>) 6.75 ms 5.63 ms 0.83 0.08 False
[ImmutableSortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).ImmutableSortedSet(Size%3a%20512).html>) 1.58 ms 1.42 ms 0.90 0.08 False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).Array(Size%3a%20512).html>) 6.74 ms 5.45 ms 0.81 0.12 False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).HashSet(Size%3a%20512).html>) 172.73 μs 109.45 μs 0.63 0.06 False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).Span(Size%3a%20512).html>) 3.96 ms 3.07 ms 0.77 0.10 False
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).ImmutableList(Size%3a%20512).html>) 11.87 ms 9.40 ms 0.79 0.03 False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).Stack(Size%3a%20512).html>) 6.99 ms 5.37 ms 0.77 0.09 False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).Queue(Size%3a%20512).html>) 6.78 ms 5.29 ms 0.78 0.10 False
[SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.ContainsTrue(String).SortedSet(Size%3a%20512).html>) 1.50 ms 1.26 ms 0.84 0.07 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsTrue<String>.ICollection(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.290062865384615 < 6.454119214086537. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.176803351335202 (T) = (0 -5414097.938101273) / Math.Sqrt((237027718810.66788 / (299)) + (32527443109.771305 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1000413656303743 = (6015940.879208929 - 5414097.938101273) / 6015940.879208929 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.351963931944445 < 6.443921867347757. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.44065241837103 (T) = (0 -5429711.730404428) / Math.Sqrt((217294396735.14957 / (299)) + (79520655444.44167 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09597086849367482 = (6006124.737769513 - 5429711.730404428) / 6006124.737769513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.LinkedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.681674648611112 < 6.669862117819177. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.377220451966648 (T) = (0 -5586030.130984678) / Math.Sqrt((256590451836.8225 / (299)) + (75101347678.25327 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10096633867506295 = (6213371.502411102 - 5586030.130984678) / 6213371.502411102 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.ImmutableHashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 218.69319283234128 < 282.9303998022617. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.202918672720617 (T) = (0 -216398.84157278895) / Math.Sqrt((1004335291.5398097 / (299)) + (8379223.2444611145 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08839922903325623 = (237383.3463779326 - 216398.84157278895) / 237383.3463779326 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.632664779761905 < 6.478209724241644. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.038122927523645 (T) = (0 -5443542.414037972) / Math.Sqrt((222268067756.7209 / (299)) + (28374616285.961193 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09963756661593168 = (6045945.734961507 - 5443542.414037972) / 6045945.734961507 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.ImmutableSortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4182204366883115 < 1.5125676578236604. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.774475159778493 (T) = (0 -1352561.077173235) / Math.Sqrt((8368499904.09942 / (299)) + (711615129.0167739 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07331588366473328 = (1459570.8001580653 - 1352561.077173235) / 1459570.8001580653 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.4470735491071425 < 6.443046165416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.172367815364758 (T) = (0 -5439554.90534089) / Math.Sqrt((238668124433.5422 / (299)) + (38923575689.21067 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09805158179743387 = (6030893.558393309 - 5439554.90534089) / 6030893.558393309 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.44506850405091 < 163.85803621618763. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.969041546235854 (T) = (0 -110883.89106289478) / Math.Sqrt((553826821.3072177 / (299)) + (7439721.729794793 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.15089948233775394 = (130589.8285967151 - 110883.89106289478) / 130589.8285967151 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.0698147559523807 < 3.7641092006380203. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.796647200713599 (T) = (0 -3150633.276180111) / Math.Sqrt((68724075487.1523 / (299)) + (17718279433.177105 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10538343151045246 = (3521769.422960248 - 3150633.276180111) / 3521769.422960248 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 9.401616160416667 < 11.332240450416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.7504624781386 (T) = (0 -9315887.24444172) / Math.Sqrt((674855061105.1592 / (299)) + (12721230520.084946 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10423898206014233 = (10399969.476085415 - 9315887.24444172) / 10399969.476085415 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.369381046130952 < 6.477703134131753. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 20.51632377798131 (T) = (0 -5383871.616929462) / Math.Sqrt((222020897062.48425 / (299)) + (14804755145.418238 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10810576175730699 = (6036446.235528274 - 5383871.616929462) / 6036446.235528274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.288750934523809 < 6.450090050731645. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.97092985760137 (T) = (0 -5395390.773333118) / Math.Sqrt((225089465097.99405 / (299)) + (22414758913.72799 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10161087247433098 = (6005627.859937519 - 5395390.773333118) / 6005627.859937519 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.SortedSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2592704922337277 < 1.4320507523336037. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.114544666775418 (T) = (0 -1271530.1188178782) / Math.Sqrt((7908834320.083181 / (299)) + (711032021.7936954 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06922569459352422 = (1366099.291130079 - 1271530.1188178782) / 1366099.291130079 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.Concurrent.AddRemoveFromDifferentThreads<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ConcurrentQueue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.AddRemoveFromDifferentThreads(String).ConcurrentQueue(Size%3a%202000000).html>) 277.56 ms 210.75 ms 0.76 0.34 False
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.Concurrent.AddRemoveFromDifferentThreads(String).ConcurrentBag(Size%3a%202000000).html>) 1.12 secs 958.27 ms 0.85 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.AddRemoveFromDifferentThreads&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Concurrent.AddRemoveFromDifferentThreads<String>.ConcurrentQueue(Size: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 210.7534691 < 264.4301145025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.248998453647863 (T) = (0 -215808543.83253983) / Math.Sqrt((573071398477164.6 / (299)) + (64614449842765.35 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10369824489730466 = (240776660.9893709 - 215808543.83253983) / 240776660.9893709 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Concurrent.AddRemoveFromDifferentThreads<String>.ConcurrentBag(Size: 2000000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 958.2653208666667 < 1.0698042739158333. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.11542717128379 (T) = (0 -965760781.3914417) / Math.Sqrt((2298196742875494 / (299)) + (312361233143132.44 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08046284997974334 = (1050268367.4826697 - 965760781.3914417) / 1050268367.4826697 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(IndexViewModel).SerializeToUtf8Bytes.html>) 871.10 μs 613.82 μs 0.70 0.02 False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(IndexViewModel).SerializeToStream.html>) 889.15 μs 624.06 μs 0.70 0.02 False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(IndexViewModel).SerializeToString.html>) 903.58 μs 627.99 μs 0.70 0.02 False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(IndexViewModel).SerializeObjectProperty.html>) 915.95 μs 639.70 μs 0.70 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;IndexViewModel&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 613.8230535416666 < 830.3065409555289. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.46977295190252 (T) = (0 -614151.1528966448) / Math.Sqrt((10993804751.972122 / (299)) + (74215792.3406658 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09520101650789921 = (678770.8254559578 - 614151.1528966448) / 678770.8254559578 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 624.0609626785715 < 846.6823553447421. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.686148160891824 (T) = (0 -626001.9576634653) / Math.Sqrt((11123685306.675129 / (299)) + (45476413.30299901 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09522754625083156 = (691888.8335619166 - 626001.9576634653) / 691888.8335619166 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 627.9918758928571 < 861.0012309545693. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.072781816642165 (T) = (0 -637816.3953916337) / Math.Sqrt((11742359504.868906 / (299)) + (41919791.57140765 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09897262297542882 = (707876.8211215411 - 637816.3953916337) / 707876.8211215411 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 639.7040480902778 < 870.8807025669641. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.063482214506699 (T) = (0 -643017.7121648731) / Math.Sqrt((11894907609.189154 / (299)) + (27456593.574486848 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09843933560029057 = (713227.3373894554 - 643017.7121648731) / 713227.3373894554 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Ctor

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>) 218.25 ns 175.73 ns 0.81 0.09 False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>) 223.47 ns 175.39 ns 0.78 0.08 False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>) 220.11 ns 186.43 ns 0.85 0.12 False
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>) 218.92 ns 172.86 ns 0.79 0.14 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Ctor*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: True, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 175.7275125244917 < 208.49260767682094. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 46.79822009037906 (T) = (0 -174.73656626630915) / Math.Sqrt((103.51435116218143 / (299)) + (4.31753493635101 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14860080770285342 = (205.23459247694987 - 174.73656626630915) / 205.23459247694987 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 175.38635344864673 < 210.50493327548136. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 40.16280734757559 (T) = (0 -176.65030426795983) / Math.Sqrt((93.57649278853621 / (299)) + (13.978293298485786 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14618685516237886 = (206.89574216095644 - 176.65030426795983) / 206.89574216095644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 186.42829934300786 < 209.22138813213616. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 35.533625330019476 (T) = (0 -176.88288415564827) / Math.Sqrt((98.68264210399668 / (299)) + (19.852071898306875 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14252068648607924 = (206.28239231893338 - 176.88288415564827) / 206.28239231893338 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 172.86273995190004 < 208.81579233087774. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 39.66561177197263 (T) = (0 -176.09056882157967) / Math.Sqrt((101.46662278117243 / (299)) + (13.767620255390986 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1474670765225854 = (206.5498750515348 - 176.09056882157967) / 206.5498750515348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Tests.Perf_Version

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Ctor4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Ctor4.html>) 61.10 ns 50.38 ns 0.82 0.31 False
[ToString3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.ToString3.html>) 950.71 ns 695.37 ns 0.73 0.06 False
[TryParse2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryParse2.html>) 686.69 ns 499.62 ns 0.73 0.12 False
[ToString2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.ToString2.html>) 729.44 ns 576.15 ns 0.79 0.06 False
[TryFormat2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryFormat2.html>) 464.97 ns 326.63 ns 0.70 0.13 False
[Parse2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Parse2.html>) 708.30 ns 518.64 ns 0.73 0.11 False
[TryFormatL - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryFormatL.html>) 1.79 μs 1.23 μs 0.69 0.06 False
[Parse3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Parse3.html>) 1.02 μs 748.16 ns 0.73 0.10 False
[ToStringL - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.ToStringL.html>) 2.13 μs 1.51 μs 0.71 0.06 False
[TryFormat3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryFormat3.html>) 689.29 ns 478.14 ns 0.69 0.14 False
[TryFormat4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryFormat4.html>) 884.99 ns 612.19 ns 0.69 0.12 False
[Ctor2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Ctor2.html>) 54.65 ns 47.27 ns 0.86 0.25 False
[TryParse4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryParse4.html>) 1.28 μs 966.36 ns 0.76 0.08 False
[ToString4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.ToString4.html>) 1.17 μs 869.74 ns 0.74 0.07 False
[Parse4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Parse4.html>) 1.31 μs 967.93 ns 0.74 0.11 False
[Ctor3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.Ctor3.html>) 57.51 ns 50.72 ns 0.88 0.24 False
[TryParse3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Version.TryParse3.html>) 1.02 μs 714.29 ns 0.70 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Version*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Version.Ctor4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.375329103987454 < 57.46240614273998. IsChangePoint: Marked as a change because one of 5/25/2022 8:13:38 AM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.639858579814216 (T) = (0 -51.635830094303095) / Math.Sqrt((14.076637068572204 / (299)) + (4.0478392402566845 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07225347417422613 = (55.65726053066357 - 51.635830094303095) / 55.65726053066357 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.ToString3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 695.3697107305968 < 889.9740393725855. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.209095422699653 (T) = (0 -709.4192946809102) / Math.Sqrt((9673.611596781584 / (299)) + (262.76564368510054 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08782399901058045 = (777.7219461062524 - 709.4192946809102) / 777.7219461062524 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryParse2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 499.62472178402606 < 654.5437739015941. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.238462679254875 (T) = (0 -510.4089180325148) / Math.Sqrt((5024.942391681368 / (299)) + (209.60992654012463 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10520507697994465 = (570.4199978133703 - 510.4089180325148) / 570.4199978133703 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.ToString2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 576.147460099672 < 694.6456373286819. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.232359787088868 (T) = (0 -564.398282760036) / Math.Sqrt((4731.922933444688 / (299)) + (129.9020692257576 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08451973506696277 = (616.5051332934182 - 564.398282760036) / 616.5051332934182 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryFormat2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 326.6330671181214 < 433.5862833071036. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.019952401135978 (T) = (0 -318.9445517502855) / Math.Sqrt((3320.1361363412843 / (299)) + (59.852542211680785 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09878201408576426 = (353.9038908846608 - 318.9445517502855) / 353.9038908846608 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Parse2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 518.6390141440316 < 669.3575034500586. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 16.537832773327843 (T) = (0 -523.6625981984822) / Math.Sqrt((4154.744617143981 / (299)) + (110.01596886276252 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11171956723562464 = (589.5239598702143 - 523.6625981984822) / 589.5239598702143 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryFormatL ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.234364893100097 < 1.6969153163620456. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.873767582921044 (T) = (0 -1233.0678383871968) / Math.Sqrt((55233.80197892002 / (299)) + (1102.6402454443255 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10280681172959963 = (1374.3615695124615 - 1233.0678383871968) / 1374.3615695124615 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Parse3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 748.161408885631 < 0.9668848501331923. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.300458061985063 (T) = (0 -743.4790871792886) / Math.Sqrt((9566.878936751009 / (299)) + (271.86762043643694 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1110543780202331 = (836.3605925900052 - 743.4790871792886) / 836.3605925900052 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.ToStringL ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.5095473762093783 < 2.0238483204666133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.553049613947577 (T) = (0 -1520.3915902763395) / Math.Sqrt((60019.30871438416 / (299)) + (844.1357306080727 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10041871995727746 = (1690.1103035449266 - 1520.3915902763395) / 1690.1103035449266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryFormat3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 478.1448935671082 < 641.5581012922413. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.707759624390299 (T) = (0 -471.06984202435063) / Math.Sqrt((7564.362650498074 / (299)) + (211.012895808802 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09072507923490598 = (518.0719618088409 - 471.06984202435063) / 518.0719618088409 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryFormat4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 612.1944926987466 < 837.2885489021576. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.125959170417474 (T) = (0 -623.1397075503698) / Math.Sqrt((13608.429866228173 / (299)) + (442.42442322224605 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.08722942429293139 = (682.6903979323182 - 623.1397075503698) / 682.6903979323182 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Ctor2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 47.26673699132755 < 52.29724516845234. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.40399654687279 (T) = (0 -48.264351355846976) / Math.Sqrt((8.237632916594386 / (299)) + (2.813385740263784 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07684115082141504 = (52.281740459718264 - 48.264351355846976) / 52.281740459718264 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryParse4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 966.3645037831676 < 1.2227109595078667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.882725751892579 (T) = (0 -939.7234977240265) / Math.Sqrt((19901.942609711918 / (299)) + (332.18538164402264 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09726342712454426 = (1040.9720021985568 - 939.7234977240265) / 1040.9720021985568 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.ToString4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 869.739072755301 < 1.102481350536261. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.777697404046515 (T) = (0 -864.6464310195372) / Math.Sqrt((14959.072126591916 / (299)) + (250.7209716116214 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08432937919737946 = (944.276698821724 - 864.6464310195372) / 944.276698821724 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Parse4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 967.9267820258933 < 1.2448112500976325. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.517771377829071 (T) = (0 -968.5400133882571) / Math.Sqrt((18264.048704060468 / (299)) + (433.6912109165865 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10386905663301826 = (1080.8018856588267 - 968.5400133882571) / 1080.8018856588267 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Ctor3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 50.71821009930742 < 55.39506715628844. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.801637751261083 (T) = (0 -49.9994123969944) / Math.Sqrt((9.097993884614962 / (299)) + (2.3792963495303714 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07862882324267245 = (54.26630836549746 - 49.9994123969944) / 54.26630836549746 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.TryParse3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 714.2902285232107 < 947.8077820721545. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.850138282197271 (T) = (0 -724.6654583011456) / Math.Sqrt((11433.903679129846 / (299)) + (260.2704503687204 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10413763373280394 = (808.9026680745845 - 724.6654583011456) / 808.9026680745845 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Collections.IndexerSet<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[IList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSet(Int32).IList(Size%3a%20512).html>) 24.18 μs 18.24 μs 0.75 0.09 False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSet(Int32).Span(Size%3a%20512).html>) 6.29 μs 3.89 μs 0.62 0.09 False
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSet(Int32).Array(Size%3a%20512).html>) 4.42 μs 2.63 μs 0.60 0.06 False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Collections.IndexerSet(Int32).List(Size%3a%20512).html>) 14.75 μs 10.79 μs 0.73 0.11 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSet&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IndexerSet<Int32>.IList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 18.242934576207244 < 22.96534442838725. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.460389057766776 (T) = (0 -18744.74422310794) / Math.Sqrt((2835844.1594848707 / (299)) + (1081115.0435399706 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12276587421355672 = (21368.0061822757 - 18744.74422310794) / 21368.0061822757 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSet<Int32>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.8928600508028106 < 5.968357787249479. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.163980287045133 (T) = (0 -3944.578253720661) / Math.Sqrt((990115.669798422 / (299)) + (234192.56423744693 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.13706184881938555 = (4571.101936244158 - 3944.578253720661) / 4571.101936244158 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSet<Int32>.Array(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.6292263933328983 < 4.192292540695729. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.511696287396369 (T) = (0 -2630.3079073212552) / Math.Sqrt((549865.3828082018 / (299)) + (521.4888513142225 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14662713041183417 = (3082.249273509985 - 2630.3079073212552) / 3082.249273509985 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.IndexerSet<Int32>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.792975631275475 < 14.032542364790528. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.080132532409188 (T) = (0 -10935.864919069289) / Math.Sqrt((1673388.536019317 / (299)) + (119137.7729999733 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12714482834307422 = (12528.842440504679 - 10935.864919069289) / 12528.842440504679 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToUtf8Bytes.html>) 482.45 μs 307.99 μs 0.64 0.01 False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToStream.html>) 494.37 μs 325.48 μs 0.66 0.02 False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeToString.html>) 504.33 μs 330.47 μs 0.66 0.02 False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Serialization.Tests.WriteJson(ImmutableSortedDictionary(String%2c%20String)).SerializeObjectProperty.html>) 501.35 μs 336.19 μs 0.67 0.02 False

Test Report.html>)

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableSortedDictionary&lt;String, String&gt;&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToUtf8Bytes ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 307.9930405357144 < 451.17870368396575. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.813000118948153 (T) = (0 -313195.25099102233) / Math.Sqrt((4381141567.343252 / (299)) + (13698093.825581413 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1078849013913546 = (351070.45209691644 - 313195.25099102233) / 351070.45209691644 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToStream ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 325.4826197415866 < 462.21540409010174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.705619638056037 (T) = (0 -319511.12975605903) / Math.Sqrt((4501960143.141335 / (299)) + (8096838.536598159 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10590118999816611 = (357355.5027496387 - 319511.12975605903) / 357355.5027496387 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 330.46797721354164 < 473.92459619391025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.303033940095103 (T) = (0 -332884.05807592126) / Math.Sqrt((4871499410.602376 / (299)) + (23973212.02898394 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1025571766328578 = (370925.0878256107 - 332884.05807592126) / 370925.0878256107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Serialization.Tests.WriteJson<ImmutableSortedDictionary<String, String>>.SerializeObjectProperty ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 336.19051994680854 < 482.69417883613784. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.50783159654958 (T) = (0 -340275.8106182859) / Math.Sqrt((4729170046.580918 / (299)) + (16392353.934087083 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10086913816357596 = (378449.7063345059 - 340275.8106182859) / 378449.7063345059 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanAllBenchmark.html>) 208.97 ns 121.18 ns 0.58 0.17 False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).InequalityOperatorBenchmark.html>) 35.71 ns 22.71 ns 0.64 0.28 False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).MinBenchmark.html>) 155.27 ns 88.79 ns 0.57 0.14 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).SquareRootBenchmark.html>) 100.81 ns 63.51 ns 0.63 0.18 False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualAllBenchmark.html>) 235.87 ns 137.54 ns 0.58 0.17 False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).AddBenchmark.html>) 127.51 ns 76.34 ns 0.60 0.24 False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsStaticBenchmark.html>) 130.24 ns 73.36 ns 0.56 0.15 False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualBenchmark.html>) 138.04 ns 80.60 ns 0.58 0.19 False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualAnyBenchmark.html>) 169.93 ns 96.12 ns 0.57 0.21 False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualBenchmark.html>) 136.17 ns 78.51 ns 0.58 0.14 False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanBenchmark.html>) 131.74 ns 75.93 ns 0.58 0.16 False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).SubtractionOperatorBenchmark.html>) 123.79 ns 74.45 ns 0.60 0.13 False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).SubtractBenchmark.html>) 128.28 ns 75.42 ns 0.59 0.15 False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).OneBenchmark.html>) 61.64 ns 42.62 ns 0.69 0.18 False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanAnyBenchmark.html>) 164.61 ns 93.12 ns 0.57 0.13 False
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GetHashCodeBenchmark.html>) 542.51 ns 400.38 ns 0.74 0.04 False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).OnesComplementOperatorBenchmark.html>) 94.97 ns 66.45 ns 0.70 0.21 False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).UnaryNegateOperatorBenchmark.html>) 127.54 ns 73.65 ns 0.58 0.21 False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).DivisionOperatorBenchmark.html>) 128.05 ns 96.58 ns 0.75 0.10 False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).ConditionalSelectBenchmark.html>) 223.36 ns 146.04 ns 0.65 0.28 False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanAllBenchmark.html>) 231.59 ns 133.95 ns 0.58 0.15 False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).AddOperatorBenchmark.html>) 124.03 ns 69.02 ns 0.56 0.13 False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).AbsBenchmark.html>) 108.70 ns 66.59 ns 0.61 0.18 False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).MultiplyBenchmark.html>) 129.88 ns 75.30 ns 0.58 0.14 False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).MaxBenchmark.html>) 154.05 ns 89.69 ns 0.58 0.17 False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).MultiplyOperatorBenchmark.html>) 124.32 ns 74.99 ns 0.60 0.11 False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualAnyBenchmark.html>) 196.69 ns 111.72 ns 0.57 0.21 False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanBenchmark.html>) 130.41 ns 77.14 ns 0.59 0.13 False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualAllBenchmark.html>) 218.53 ns 125.68 ns 0.58 0.19 False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).AndNotBenchmark.html>) 125.62 ns 89.97 ns 0.72 0.29 False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).EqualityOperatorBenchmark.html>) 34.00 ns 21.52 ns 0.63 0.22 False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsAnyBenchmark.html>) 185.25 ns 106.83 ns 0.58 0.19 False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).DotBenchmark.html>) 101.01 ns 53.90 ns 0.53 0.17 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).DivideBenchmark.html>) 134.31 ns 84.84 ns 0.63 0.13 False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsAllBenchmark.html>) 34.04 ns 22.92 ns 0.67 0.31 False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanAnyBenchmark.html>) 186.72 ns 105.65 ns 0.57 0.16 False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).OnesComplementBenchmark.html>) 93.79 ns 66.17 ns 0.71 0.19 False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Numerics.Tests.Perf_VectorOf(Int32).NegateBenchmark.html>) 126.55 ns 76.79 ns 0.61 0.24 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 121.17753229556818 < 204.5668063765133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.230965769899914 (T) = (0 -123.69258256249803) / Math.Sqrt((1039.3830659069495 / (299)) + (21.492194102133876 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1947969315843814 = (153.61663090266828 - 123.69258256249803) / 153.61663090266828 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.710949291284017 < 34.01109008751755. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.216903467355465 (T) = (0 -22.150488147754473) / Math.Sqrt((35.99310154925512 / (299)) + (1.1475785867964627 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.1353933972502827 = (25.61915219859419 - 22.150488147754473) / 25.61915219859419 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.MinBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 88.79122631041582 < 147.614967634257. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.215301128250344 (T) = (0 -89.88340112892772) / Math.Sqrt((683.0977605985463 / (299)) + (16.061328223117172 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17908156817456714 = (109.4912693445788 - 89.88340112892772) / 109.4912693445788 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 63.509055348853934 < 95.90672045435831. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.413252262532552 (T) = (0 -64.7058503382232) / Math.Sqrt((243.9985554723979 / (299)) + (7.8811221174074255 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12471842583712654 = (73.92575400677023 - 64.7058503382232) / 73.92575400677023 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 137.53528138055697 < 222.7044887036428. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.297660535082725 (T) = (0 -137.95594086786983) / Math.Sqrt((1352.7414880129545 / (299)) + (10.864650710940143 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19416920059918766 = (171.19715574342536 - 137.95594086786983) / 171.19715574342536 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.AddBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.33760970172047 < 121.87838824168708. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.166892083951037 (T) = (0 -76.54223284650433) / Math.Sqrt((436.36204946766424 / (299)) + (3.8018831160438538 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17531923500041707 = (92.8143787208897 - 76.54223284650433) / 92.8143787208897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.36013060805676 < 124.45923102640452. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.213979898529653 (T) = (0 -76.98268617209116) / Math.Sqrt((486.14920567633925 / (299)) + (7.537487566790965 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1619736159308477 = (91.86188840295355 - 76.98268617209116) / 91.86188840295355 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 80.59654192134758 < 131.00566432944035. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.703856315741834 (T) = (0 -81.45740861507163) / Math.Sqrt((573.2820445011329 / (299)) + (3.5426879804083935 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15606828792345254 = (96.52132684366192 - 81.45740861507163) / 96.52132684366192 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.11645973788042 < 162.20261474472073. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.293669002815697 (T) = (0 -97.86665264575727) / Math.Sqrt((955.2945838787832 / (299)) + (10.703573911490352 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14875073863817362 = (114.96826733122852 - 97.86665264575727) / 114.96826733122852 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 78.51028816257245 < 129.90129023923583. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.253179507453632 (T) = (0 -80.58690750100068) / Math.Sqrt((579.1621833262581 / (299)) + (11.225859332919455 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.14384584654409863 = (94.12663265804215 - 80.58690750100068) / 94.12663265804215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.93388909266302 < 125.13502735564957. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.152741164036657 (T) = (0 -77.46759923522526) / Math.Sqrt((507.6449023403232 / (299)) + (11.574629961342731 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1657482687570589 = (92.8587815092781 - 77.46759923522526) / 92.8587815092781 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.44880904584684 < 118.63587667306841. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.442993170005817 (T) = (0 -74.3762515061677) / Math.Sqrt((413.0487935513351 / (299)) + (8.538881430126525 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.16017253866855377 = (88.56134733705068 - 74.3762515061677) / 88.56134733705068 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.41580688136669 < 122.65143074661412. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.034377143395039 (T) = (0 -75.94619364956324) / Math.Sqrt((438.74882277038984 / (299)) + (3.0624346523254617 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17474019117137476 = (92.02701117525808 - 75.94619364956324) / 92.02701117525808 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.OneBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.6155945743126 < 58.72245103856638. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.667946036994142 (T) = (0 -43.02621818889214) / Math.Sqrt((67.57584971732359 / (299)) + (2.108148709774705 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10356182090470435 = (47.99686045535801 - 43.02621818889214) / 47.99686045535801 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 93.11559524059358 < 154.50606189634277. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.796027045868318 (T) = (0 -93.3440827654314) / Math.Sqrt((772.4577419108158 / (299)) + (4.135580007279412 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17081381149525612 = (112.57312779625171 - 93.3440827654314) / 112.57312779625171 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 400.3847408456825 < 522.6341640603383. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.914466594409168 (T) = (0 -404.0574952168285) / Math.Sqrt((3165.801378368079 / (299)) + (110.76234207315044 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1019001147711955 = (449.9026242653274 - 404.0574952168285) / 449.9026242653274 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.44617160774436 < 89.13960202002748. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.7116460634612 (T) = (0 -67.38641637111552) / Math.Sqrt((120.74822506064692 / (299)) + (3.892376521292495 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11487460234592883 = (76.13205603377318 - 67.38641637111552) / 76.13205603377318 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 73.65030236753213 < 120.96393924016567. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.179240602849132 (T) = (0 -76.92183292468654) / Math.Sqrt((429.19658362390317 / (299)) + (91.43703228275872 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15701104582497527 = (91.24892152349095 - 76.92183292468654) / 91.24892152349095 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 96.58054865736739 < 123.35975148773313. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.495537050419172 (T) = (0 -83.51664600785831) / Math.Sqrt((317.8544002687552 / (299)) + (7.298254105294601 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13071058196009475 = (96.07461482295926 - 83.51664600785831) / 96.07461482295926 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 146.03697431882674 < 195.6887246239568. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.672615650986768 (T) = (0 -152.37664408305702) / Math.Sqrt((563.7474249720085 / (299)) + (56.7092782246551 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07895224994122756 = (165.4383761030129 - 152.37664408305702) / 165.4383761030129 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 133.95015143240576 < 220.34929823330395. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.959479795806205 (T) = (0 -136.5733478093681) / Math.Sqrt((1174.729745993621 / (299)) + (22.005767124807697 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19558120475601407 = (169.77891195088802 - 136.5733478093681) / 169.77891195088802 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 69.02168322551202 < 118.2481684919191. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.977031010184776 (T) = (0 -74.43473903690798) / Math.Sqrt((405.0780531849315 / (299)) + (8.199455820095622 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16468129010569993 = (89.10938801589496 - 74.43473903690798) / 89.10938801589496 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.AbsBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.59357387251579 < 103.32897057205754. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.607589199767283 (T) = (0 -67.37686474729459) / Math.Sqrt((287.0183422746576 / (299)) + (9.10108095995695 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.14328098533453199 = (78.64523092627276 - 67.37686474729459) / 78.64523092627276 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 75.29748860047339 < 121.77837771659853. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.835279121051359 (T) = (0 -76.93093231245632) / Math.Sqrt((410.6689584971182 / (299)) + (4.291770387607929 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.16743559692726542 = (92.4023799582691 - 76.93093231245632) / 92.4023799582691 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.MaxBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.69483607186076 < 146.68922176363856. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.56279059617227 (T) = (0 -90.05293461124246) / Math.Sqrt((678.3894045959026 / (299)) + (5.432763254400494 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16492488362727933 = (107.83812479337364 - 90.05293461124246) / 107.83812479337364 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 74.9936279631933 < 118.0152298115504. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.258227883468338 (T) = (0 -74.46022189828142) / Math.Sqrt((411.0446787765025 / (299)) + (2.6685262022986223 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1641599280331204 = (89.08429303115767 - 74.46022189828142) / 89.08429303115767 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 111.72379151452792 < 186.51796459650845. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.270690169013642 (T) = (0 -112.616868685055) / Math.Sqrt((1149.1737546065278 / (299)) + (3.068643415213271 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1649939622690761 = (134.86952620257 - 112.616868685055) / 134.86952620257 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 77.14233799828344 < 124.5209139120148. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.360239165467203 (T) = (0 -76.56777741124127) / Math.Sqrt((477.0232097842184 / (299)) + (6.1153038120398735 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.17415735069719965 = (92.7147289812193 - 76.56777741124127) / 92.7147289812193 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 125.68086047301398 < 203.492160280742. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.191833008807759 (T) = (0 -127.80519495115004) / Math.Sqrt((1301.787134408415 / (299)) + (10.729099659614999 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1914833731061183 = (158.0736755435019 - 127.80519495115004) / 158.0736755435019 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.AndNotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 89.96588883541614 < 120.13426119780569. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.9400797236104 (T) = (0 -91.74798337852236) / Math.Sqrt((271.609641711346 / (299)) + (7.9898111374953125 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10008015753079637 = (101.95128393522681 - 91.74798337852236) / 101.95128393522681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 21.52024715626282 < 32.4875530053736. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.5657991717222 (T) = (0 -21.67219428650779) / Math.Sqrt((29.040832823953533 / (299)) + (1.020551911964195 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1303661591003368 = (24.92105673358713 - 21.67219428650779) / 24.92105673358713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.82779104985681 < 179.15347604916133. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.017097526397988 (T) = (0 -107.28775419993822) / Math.Sqrt((1059.8101907066336 / (299)) + (13.393740550918324 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17889759681739514 = (130.6630619811723 - 107.28775419993822) / 130.6630619811723 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 53.89988864946668 < 95.10927504088859. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.287690636425246 (T) = (0 -54.39272953862819) / Math.Sqrt((295.0234181611355 / (299)) + (3.3700616023401198 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.22334556155682547 = (70.03466000614112 - 54.39272953862819) / 70.03466000614112 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 84.83932759765868 < 123.99530608440209. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.23893264019805 (T) = (0 -86.2558131263363) / Math.Sqrt((323.3426378811218 / (299)) + (8.192402490391496 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12615852670323488 = (98.70876556238134 - 86.2558131263363) / 98.70876556238134 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 22.923306468856506 < 32.741879791318965. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.043524644449107 (T) = (0 -21.642596498388162) / Math.Sqrt((29.851369858127754 / (299)) + (4.938670328113959 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.13929801353560842 = (25.145284707999853 - 21.642596498388162) / 25.145284707999853 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 105.65353092599301 < 179.7527838924525. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.301896951221963 (T) = (0 -107.19933368853458) / Math.Sqrt((1053.8186163186076 / (299)) + (10.386281550397783 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.18102359989559252 = (130.89428910878047 - 107.19933368853458) / 130.89428910878047 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.17277628485732 < 89.70312839965749. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.341433995645273 (T) = (0 -67.40394374849598) / Math.Sqrt((143.55329176834908 / (299)) + (6.770860692920444 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11539250085184326 = (76.1964417138713 - 67.40394374849598) / 76.1964417138713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int32>.NegateBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 76.78515948334466 < 121.06505908472336. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.534503676229468 (T) = (0 -74.64653918496765) / Math.Sqrt((449.8058160364132 / (299)) + (2.453951319078363 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.18411360947073072 = (91.49134003392813 - 74.64653918496765) / 91.49134003392813 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.IO.Tests.BinaryWriterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteNonAsciiChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteNonAsciiChar.html>) 227.43 ns 170.19 ns 0.75 0.24 False
[WriteDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteDouble.html>) 87.15 ns 71.47 ns 0.82 0.24 False
[DefaultCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.DefaultCtor.html>) 168.41 ns 135.82 ns 0.81 0.21 False
[WriteUInt16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteUInt16.html>) 91.60 ns 68.13 ns 0.74 0.22 False
[WriteAsciiChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteAsciiChar.html>) 195.36 ns 144.91 ns 0.74 0.21 False
[WriteSingle - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteSingle.html>) 86.01 ns 66.29 ns 0.77 0.22 False
[WriteUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.BinaryWriterTests.WriteUInt32.html>) 87.20 ns 66.10 ns 0.76 0.27 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.BinaryWriterTests.WriteNonAsciiChar ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 170.18859840444847 < 215.97012686233208. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.760689200493568 (T) = (0 -169.6878783367249) / Math.Sqrt((596.6933735667086 / (299)) + (28.79059195678986 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0835159825710735 = (185.1509411072564 - 169.6878783367249) / 185.1509411072564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.WriteDouble ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 71.46717444042274 < 82.34462639257401. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.776032015215225 (T) = (0 -68.65333751654333) / Math.Sqrt((61.76017524247253 / (299)) + (6.228677391201866 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07452593990590081 = (74.18180635939476 - 68.65333751654333) / 74.18180635939476 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.DefaultCtor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 135.81662675168303 < 148.55383303390013. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.793978072418266 (T) = (0 -135.34730976344323) / Math.Sqrt((39.971277589037896 / (299)) + (15.084543065645747 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07703500892775929 = (146.64403425118599 - 135.34730976344323) / 146.64403425118599 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.WriteUInt16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 68.12539477271602 < 86.22566190365714. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.05280360006518 (T) = (0 -69.78956733427205) / Math.Sqrt((77.7497395104335 / (299)) + (5.135673113592587 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07870576694926164 = (75.7516598179211 - 69.78956733427205) / 75.7516598179211 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.WriteAsciiChar ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 144.91382904507446 < 184.90273228028227. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.593324344662342 (T) = (0 -148.89657779046402) / Math.Sqrt((352.25050270266075 / (299)) + (29.899841561759853 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08516208066488148 = (162.75733071785913 - 148.89657779046402) / 162.75733071785913 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.WriteSingle ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.28561426460034 < 82.05958527660307. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.935841343546938 (T) = (0 -68.64841772471794) / Math.Sqrt((55.318819845979405 / (299)) + (6.201631009517542 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07296851681539153 = (74.05187307004043 - 68.64841772471794) / 74.05187307004043 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.BinaryWriterTests.WriteUInt32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 66.10445689839862 < 83.20736309620646. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.002208311029426 (T) = (0 -68.76494693518504) / Math.Sqrt((59.107443709211836 / (299)) + (6.205946475967571 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07475115331638174 = (74.32048921937071 - 68.76494693518504) / 74.32048921937071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Globalization.Tests.StringEquality

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Compare_Same - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>) 3.66 μs 2.33 μs 0.64 0.08 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20IgnoreNonSpace)).html>) 306.39 ns 273.56 ns 0.89 0.11 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(%2c%20IgnoreCase)).html>) 305.91 ns 281.52 ns 0.92 0.19 False
[Compare_Same - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>) 22.18 μs 14.04 μs 0.63 0.05 False
[Compare_Same_Upper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20OrdinalIgnoreCase)).html>) 38.26 μs 24.43 μs 0.64 0.08 False
[Compare_Same_Upper - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>) 519.28 ns 363.45 ns 0.70 0.08 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20IgnoreCase)).html>) 310.99 ns 264.78 ns 0.85 0.16 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(pl-PL%2c%20None)).html>) 304.77 ns 263.35 ns 0.86 0.12 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(%2c%20None)).html>) 303.55 ns 281.44 ns 0.93 0.17 False
[Compare_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count%3a%201024%2c%20Options%3a%20(en-US%2c%20Ordinal)).html>) 229.74 ns 172.75 ns 0.75 0.19 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringEquality*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.3288978666865345 < 3.443997488056647. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.079552852232124 (T) = (0 -2324.810248912687) / Math.Sqrt((260954.5018536538 / (299)) + (9914.296105400052 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.15438221877832475 = (2749.244753999854 - 2324.810248912687) / 2749.244753999854 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, IgnoreNonSpace)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 273.55616225929674 < 293.5648991526232. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.917218960653829 (T) = (0 -269.0268505622948) / Math.Sqrt((268.01805696832383 / (299)) + (39.847937468426096 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0573907126808729 = (285.4065350103153 - 269.0268505622948) / 285.4065350103153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (, IgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 281.5248788842749 < 290.41908208434234. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.830389484692738 (T) = (0 -270.23979147726794) / Math.Sqrt((288.97660330926084 / (299)) + (69.11224826286214 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.051446874835194854 = (284.89684373799884 - 270.23979147726794) / 284.89684373799884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same(Count: 1024, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.04353143396782 < 21.045217452882405. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.25081259613392 (T) = (0 -14069.50900909298) / Math.Sqrt((11379335.205084708 / (299)) + (960.5807004933341 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.12447251374463073 = (16069.751355572245 - 14069.50900909298) / 16069.751355572245 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, OrdinalIgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.430426141105897 < 36.37421028210262. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 4.659938597401465 (T) = (0 -23570.02637173843) / Math.Sqrt((50581388.306248896 / (299)) + (720474.0468340017 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07779042841563617 = (25558.210517426018 - 23570.02637173843) / 25558.210517426018 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 363.44957441769753 < 498.1961831097467. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.53413644211245 (T) = (0 -364.8008141948465) / Math.Sqrt((3976.910999418132 / (299)) + (53.48533571430834 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11483134629532646 = (412.12577136351933 - 364.8008141948465) / 412.12577136351933 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, IgnoreCase)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 264.7793329641346 < 294.384416832453. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.159729705296037 (T) = (0 -267.5974353775842) / Math.Sqrt((297.52598875996637 / (299)) + (56.734372621297126 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06542780520809033 = (286.3314753732503 - 267.5974353775842) / 286.3314753732503 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (pl-PL, None)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 263.35060569034573 < 295.3445066246003. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.110948392622104 (T) = (0 -267.93693142999564) / Math.Sqrt((287.98333160772034 / (299)) + (35.28342001327794 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06254156435253744 = (285.81206509165713 - 267.93693142999564) / 285.81206509165713 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (, None)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 281.4356168208129 < 298.819138053798. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.172512968734454 (T) = (0 -268.54218812750895) / Math.Sqrt((316.2151138906503 / (299)) + (48.30590678128867 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05909933505782627 = (285.40971234621577 - 268.54218812750895) / 285.40971234621577 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (en-US, Ordinal)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 172.7458506368075 < 219.35485947699968. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.251707614010027 (T) = (0 -179.85044672924104) / Math.Sqrt((545.4866986823196 / (299)) + (25.03721226231378 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07195058698153738 = (193.7940417895217 - 179.85044672924104) / 193.7940417895217 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[MeasureReverseUsingNtoH - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseUsingNtoH.html>) 26.28 μs 15.28 μs 0.58 0.13 False
[ReadStructAndReverseLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseLE.html>) 58.86 ns 43.81 ns 0.74 0.28 False
[ReadStructAndReverseBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseBE.html>) 458.71 ns 290.15 ns 0.63 0.10 False
[ReadStructFieldByFieldUsingBitConverterBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE.html>) 827.41 ns 558.72 ns 0.68 0.06 False
[ReadStructFieldByFieldLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE.html>) 891.76 ns 663.33 ns 0.74 0.06 False
[MeasureReverseEndianness - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseEndianness.html>) 26.24 μs 15.31 μs 0.58 0.08 False
[ReadStructFieldByFieldBE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE.html>) 1.24 μs 833.58 ns 0.67 0.08 False
[ReadStructFieldByFieldUsingBitConverterLE - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterLE.html>) 418.07 ns 319.40 ns 0.76 0.08 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseUsingNtoH ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.279624628704221 < 24.970642309629028. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 161.54326474881685 (T) = (0 -15350.500987114172) / Math.Sqrt((565078.2133185562 / (299)) + (119477.28254205275 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.40030677780200147 = (25597.256095127173 - 15350.500987114172) / 25597.256095127173 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 43.810386934148916 < 56.17689844119135. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.592724084248092 (T) = (0 -44.451158985183895) / Math.Sqrt((43.00638035882305 / (299)) + (3.144347998139264 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07975427118792151 = (48.303575440186776 - 44.451158985183895) / 48.303575440186776 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructAndReverseBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 290.15320392466367 < 437.5814388721256. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.784023943251857 (T) = (0 -295.4490921834568) / Math.Sqrt((5098.146395591664 / (299)) + (62.85823400776058 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10097379197686701 = (328.63234636186996 - 295.4490921834568) / 328.63234636186996 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 558.7210045053329 < 797.9559847600252. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.554637869219905 (T) = (0 -571.6452645927272) / Math.Sqrt((9123.990898035685 / (299)) + (92.74290979106075 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.1262416160376093 = (654.2372297480955 - 571.6452645927272) / 654.2372297480955 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 663.3277713228802 < 854.9848550119012. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.448931215510643 (T) = (0 -672.9968946480084) / Math.Sqrt((10982.59709869692 / (299)) + (85.19648771446072 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05594991170752809 = (712.8826139567186 - 672.9968946480084) / 712.8826139567186 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.MeasureReverseEndianness ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.309760945874537 < 25.07949300971343. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 13.305696042443305 (T) = (0 -15312.149954464718) / Math.Sqrt((18722779.70583175 / (299)) + (38343.150851278355 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.17940731731923348 = (18659.866554551732 - 15312.149954464718) / 18659.866554551732 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldBE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 833.5774488930547 < 1.1543037860959582. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.488266903926415 (T) = (0 -838.5938831946903) / Math.Sqrt((26840.604534570386 / (299)) + (2119.5976533413727 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08057782723436663 = (912.0879483167014 - 838.5938831946903) / 912.0879483167014 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterLE ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 319.4048952749011 < 398.1822007689753. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 29.65204157064513 (T) = (0 -319.44988925206945) / Math.Sqrt((733.7774953589924 / (299)) + (40.312035862919444 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.142153056855493 = (372.3856473523123 - 319.44988925206945) / 372.3856473523123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in Benchstone.MDBenchI.MDMidpoint

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/Benchstone.MDBenchI.MDMidpoint.Test.html>) 6.43 secs 4.66 secs 0.72 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDMidpoint*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Benchstone.MDBenchI.MDMidpoint.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 4.657467206214286 < 6.106113567795. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.775690709679484 (T) = (0 -4693890600.997855) / Math.Sqrt((3.980366954963353E+17 / (299)) + (6282064256464914 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12585688084343621 = (5369704912.310994 - 4693890600.997855) / 5369704912.310994 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Tests.Perf_Boolean

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%220%22).html>) 95.21 ns 79.52 ns 0.84 0.15 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.Parse(value%3a%20%22False%22).html>) 156.64 ns 119.72 ns 0.76 0.16 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22true%22).html>) 105.00 ns 81.43 ns 0.78 0.20 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22Bogus%22).html>) 393.29 ns 268.30 ns 0.68 0.16 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22false%22).html>) 137.81 ns 106.15 ns 0.77 0.25 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22TRUE%22).html>) 105.06 ns 81.13 ns 0.77 0.21 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.Parse(value%3a%20%22true%22).html>) 122.75 ns 100.57 ns 0.82 0.20 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22False%22).html>) 140.33 ns 113.57 ns 0.81 0.27 False
[TryParse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.TryParse(value%3a%20%22%20True%20%22).html>) 551.13 ns 390.98 ns 0.71 0.07 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.Parse(value%3a%20%22false%22).html>) 157.95 ns 122.08 ns 0.77 0.18 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Tests.Perf_Boolean.Parse(value%3a%20%22%20True%20%22).html>) 543.44 ns 395.51 ns 0.73 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Boolean*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Boolean.TryParse(value: "0") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 79.51518496913268 < 89.84893922742646. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 37.70868534528596 (T) = (0 -75.86178012708187) / Math.Sqrt((12.629920816871198 / (299)) + (11.339122664144409 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.19855230781129146 = (94.65593433790747 - 75.86178012708187) / 94.65593433790747 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.Parse(value: "False") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 119.7180159331647 < 148.7339386989772. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.533756744977044 (T) = (0 -122.90626515615365) / Math.Sqrt((220.4519162479235 / (299)) + (16.835910617138953 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.073602156493601 = (132.67114773384583 - 122.90626515615365) / 132.67114773384583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: "true") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.42604321220439 < 99.71062409730658. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.15463571187554 (T) = (0 -83.3125818222377) / Math.Sqrt((113.76238473198644 / (299)) + (2.853995851270185 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.060407900284019565 = (88.66888285610469 - 83.3125818222377) / 88.66888285610469 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: "Bogus") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 268.29957361675815 < 360.34189969107393. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.192702820447073 (T) = (0 -275.63535814820364) / Math.Sqrt((1511.1190915493107 / (299)) + (30.790757531799624 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09478823401333852 = (304.4982052876511 - 275.63535814820364) / 304.4982052876511 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: "false") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.15056254530502 < 132.6167558633439. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.744891021259688 (T) = (0 -106.10518895421949) / Math.Sqrt((197.69198075062673 / (299)) + (16.072246116569673 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07448023145957393 = (114.64389261133852 - 106.10518895421949) / 114.64389261133852 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: "TRUE") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 81.1295397957184 < 100.42644937653586. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.663922308749295 (T) = (0 -83.29291077348874) / Math.Sqrt((112.21557133993787 / (299)) + (6.156884306326704 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06023434299667087 = (88.63157549200979 - 83.29291077348874) / 88.63157549200979 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.Parse(value: "true") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 100.57349924069962 < 117.8988692787807. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.479292605263311 (T) = (0 -100.54529713723285) / Math.Sqrt((138.55755657870645 / (299)) + (15.264547662997844 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.05998827057149154 = (106.96174737985513 - 100.54529713723285) / 106.96174737985513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: "False") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.56503154869326 < 130.46488664632068. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.687059732055418 (T) = (0 -107.22960149000016) / Math.Sqrt((202.41147547602455 / (299)) + (27.901474428987342 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.0637873422990383 = (114.5355177672151 - 107.22960149000016) / 114.5355177672151 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.TryParse(value: " True ") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 390.9802776487188 < 496.47428340137884. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.97359748013297 (T) = (0 -391.6397120971187) / Math.Sqrt((2127.1166824068096 / (299)) + (81.05197844653746 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11838607692075014 = (444.23040726174366 - 391.6397120971187) / 444.23040726174366 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.Parse(value: "false") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 122.08125948196509 < 148.73789373963248. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.594537308930029 (T) = (0 -122.38412779229371) / Math.Sqrt((219.24421079982105 / (299)) + (11.499270138612218 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07737866078707296 = (132.64827355575537 - 122.38412779229371) / 132.64827355575537 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Boolean.Parse(value: " True ") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 395.51123684611224 < 516.518103286375. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.210513930431258 (T) = (0 -409.181479698232) / Math.Sqrt((2109.994885249236 / (299)) + (109.76383670354987 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11809065454119054 = (463.9722685843148 - 409.181479698232) / 463.9722685843148 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.IO.Tests.StringReaderReadLineTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>) 1.77 ms 1.48 ms 0.83 0.03 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>) 174.19 μs 98.27 μs 0.56 0.04 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>) 4.26 ms 3.49 ms 0.82 0.08 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>) 1.30 ms 1.07 ms 0.83 0.06 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>) 181.22 μs 106.89 μs 0.59 0.04 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>) 5.07 ms 3.82 ms 0.75 0.16 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>) 187.15 μs 111.85 μs 0.60 0.03 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>) 186.20 μs 110.34 μs 0.59 0.03 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>) 283.75 μs 189.70 μs 0.67 0.03 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>) 245.91 μs 164.31 μs 0.67 0.06 False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>) 566.28 μs 437.49 μs 0.77 0.02 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>) 449.51 μs 336.07 μs 0.75 0.04 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>) 171.70 μs 98.48 μs 0.57 0.10 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>) 2.49 ms 1.82 ms 0.73 0.16 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>) 180.79 μs 107.46 μs 0.59 0.06 False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>) 2.97 ms 2.56 ms 0.86 0.11 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadLineTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.4763014632575762 < 1.6916431013847553. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.08096227242618 (T) = (0 -1459555.539222032) / Math.Sqrt((10091286774.543152 / (299)) + (511608651.8786294 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09768107705251808 = (1617560.600917358 - 1459555.539222032) / 1617560.600917358 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.27210706129807 < 165.50390998387894. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.566785148226176 (T) = (0 -97897.20517236994) / Math.Sqrt((1029914888.660221 / (299)) + (275535.65896412026 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.166992359583952 = (117522.57773227015 - 97897.20517236994) / 117522.57773227015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.4897958389423076 < 3.9909982981777987. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.883857719979137 (T) = (0 -3460565.6453030556) / Math.Sqrt((46669181676.58285 / (299)) + (4269681854.5843773 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.09518498829972702 = (3824611.219480292 - 3460565.6453030556) / 3824611.219480292 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0725518863888888 < 1.244954801390749. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.644978476587834 (T) = (0 -1051490.8651012233) / Math.Sqrt((8569356084.841122 / (299)) + (290137819.0992508 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07494983262358561 = (1136685.2330651584 - 1051490.8651012233) / 1136685.2330651584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 106.88813419021454 < 172.67675795283083. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.636262570818547 (T) = (0 -106657.51967885364) / Math.Sqrt((954937425.8286498 / (299)) + (395651.7950324299 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15140190061579442 = (125686.72939080447 - 106657.51967885364) / 125686.72939080447 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.8235889812500004 < 4.647579894233631. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 25.92279847349507 (T) = (0 -3819768.463055103) / Math.Sqrt((97539804868.42876 / (299)) + (9109709124.599777 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.13047675715857388 = (4392945.783223542 - 3819768.463055103) / 4392945.783223542 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 111.84561091058767 < 177.94080938113422. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.604139870102427 (T) = (0 -112069.69813737672) / Math.Sqrt((982903875.1055061 / (299)) + (2097114.21984886 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.14714401463437557 = (131405.1845333908 - 112069.69813737672) / 131405.1845333908 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.33554470815278 < 176.68408272159826. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.760545137054345 (T) = (0 -110263.88666948116) / Math.Sqrt((1001369925.3650652 / (299)) + (1147793.1955718575 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.15192279401050007 = (130016.33093160429 - 110263.88666948116) / 130016.33093160429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 189.70071031378603 < 263.9370444791667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.888714503113784 (T) = (0 -189570.68423078055) / Math.Sqrt((1225652899.5822773 / (299)) + (3583724.401372985 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12182378753873743 = (215868.616731796 - 189570.68423078055) / 215868.616731796 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 164.31157830756013 < 233.69052074148993. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 11.460990993399601 (T) = (0 -162211.45871208326) / Math.Sqrt((1191806058.3394027 / (299)) + (1837239.3064735685 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12406760916248806 = (185187.190711131 - 162211.45871208326) / 185187.190711131 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 437.4857803151709 < 534.4999811941964. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 18.523569951547834 (T) = (0 -434091.860202802) / Math.Sqrt((1992215646.0817616 / (299)) + (41768941.992323644 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10406261100704818 = (484511.37940646533 - 434091.860202802) / 484511.37940646533 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 336.0709218085106 < 425.2981013933218. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.711110579449633 (T) = (0 -337628.19406999124) / Math.Sqrt((1972452661.7656622 / (299)) + (19351869.673958417 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09028231828611341 = (371135.13440115587 - 337628.19406999124) / 371135.13440115587 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 98.48194678244774 < 163.1856822991889. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.121110743783776 (T) = (0 -96231.96451843869) / Math.Sqrt((1042740763.8779579 / (299)) + (11355164.582443109 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.16807973965106804 = (115674.50524413981 - 96231.96451843869) / 115674.50524413981 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.8220137881944443 < 2.3630582859890112. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.627762391092933 (T) = (0 -1880021.6555491737) / Math.Sqrt((69662358625.49506 / (299)) + (5383881577.348471 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08500810583520907 = (2054686.6781429432 - 1880021.6555491737) / 2054686.6781429432 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 107.45522290249431 < 173.06619198123215. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 10.554010139940495 (T) = (0 -106035.46748873753) / Math.Sqrt((1049250698.4831623 / (299)) + (856428.6744582991 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.1574401331743627 = (125849.17898858448 - 106035.46748873753) / 125849.17898858448 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 2.5576394928571426 < 2.829345559268162. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 14.7908356961413 (T) = (0 -2428469.086851918) / Math.Sqrt((40564958203.06645 / (299)) + (3097186839.3536396 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.0780169226232457 = (2633962.7553267567 - 2428469.086851918) / 2633962.7553267567 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Net.Tests.DnsTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHostName - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Net.Tests.DnsTests.GetHostName.html>) 1.36 μs 1.17 μs 0.86 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Tests.DnsTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Tests.DnsTests.GetHostName ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.172978729471423 < 1.2703516712863032. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.42457734417024 (T) = (0 -1190.8857450313808) / Math.Sqrt((1561.0637880094391 / (299)) + (494.8750283593817 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06352818808510236 = (1271.672814792212 - 1190.8857450313808) / 1271.672814792212 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.ConsoleTests.Perf_Console

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[BackgroundColor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ConsoleTests.Perf_Console.BackgroundColor.html>) 292.67 ns 266.45 ns 0.91 0.11 False
[ResetColor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ConsoleTests.Perf_Console.ResetColor.html>) 887.33 ns 781.26 ns 0.88 0.04 False
[ForegroundColor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.ConsoleTests.Perf_Console.ForegroundColor.html>) 297.29 ns 252.27 ns 0.85 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ConsoleTests.Perf_Console*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.ConsoleTests.Perf_Console.BackgroundColor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 266.45416883991504 < 274.9112491603944. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 50.66093217588748 (T) = (0 -255.41173675732077) / Math.Sqrt((51.97030581045674 / (299)) + (19.38541536484404 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.12513214370273604 = (291.9432173886345 - 255.41173675732077) / 291.9432173886345 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ConsoleTests.Perf_Console.ResetColor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 781.2609778358981 < 834.6805507901997. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 41.634394004043294 (T) = (0 -780.4393031946977) / Math.Sqrt((293.9608886802565 / (299)) + (286.41244156781164 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.11717994295809102 = (884.0298733240594 - 780.4393031946977) / 884.0298733240594 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.ConsoleTests.Perf_Console.ForegroundColor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 252.26828742891874 < 277.96652070931276. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 46.99916103649902 (T) = (0 -256.0955957230439) / Math.Sqrt((51.757732626790656 / (299)) + (22.588630096871185 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.12297924639578571 = (292.006311903784 - 256.0955957230439) / 292.006311903784 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare f9e9d86e77210bee1779970273d124ceeae0df7e
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Segment

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json400KB).html>) 15.41 ms 10.95 ms 0.71 0.02 False
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json40KB).html>) 1.55 ms 1.10 ms 0.71 0.01 False
[ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json4KB).html>) 156.79 μs 109.89 μs 0.70 0.03 False
[ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json400KB).html>) 15.28 ms 10.62 ms 0.70 0.02 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json40KB).html>) 1.59 ms 1.09 ms 0.69 0.02 False
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json4KB).html>) 157.59 μs 109.40 μs 0.69 0.02 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json400KB).html>) 17.72 ms 13.05 ms 0.74 0.02 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json40KB).html>) 1.58 ms 1.11 ms 0.70 0.02 False
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json4KB).html>) 171.57 μs 113.30 μs 0.66 0.01 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json4KB).html>) 166.97 μs 116.46 μs 0.70 0.02 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json4KB).html>) 161.65 μs 115.34 μs 0.71 0.02 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json4KB).html>) 183.90 μs 135.33 μs 0.74 0.02 False
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json40KB).html>) 1.52 ms 1.07 ms 0.71 0.02 False
[ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json40KB).html>) 1.50 ms 1.06 ms 0.70 0.02 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json400KB).html>) 15.58 ms 11.02 ms 0.71 0.03 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json40KB).html>) 1.76 ms 1.29 ms 0.73 0.02 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json4KB).html>) 159.34 μs 111.00 μs 0.70 0.02 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json400KB).html>) 17.81 ms 12.73 ms 0.71 0.02 False
[ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json400KB).html>) 16.79 ms 10.70 ms 0.64 0.03 False
[ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json40KB).html>) 1.76 ms 1.30 ms 0.74 0.02 False
[ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json400KB).html>) 15.76 ms 11.25 ms 0.71 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Segment*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.94587784637681 < 14.694821103301585. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.082224486452736 (T) = (0 -10913793.526847033) / Math.Sqrt((3717949432766.0264 / (299)) + (9664607077.38092 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08545380301171401 = (11933561.762967806 - 10913793.526847033) / 11933561.762967806 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0952088032051284 < 1.4523972124086173. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.278223909820653 (T) = (0 -1083217.0101097268) / Math.Sqrt((36458735326.05489 / (299)) + (104580832.98857582 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08701218814537579 = (1186452.870503608 - 1083217.0101097268) / 1186452.870503608 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.89227614436619 < 149.66477096283145. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.551052898662153 (T) = (0 -110566.36008319841) / Math.Sqrt((379652410.1388911 / (299)) + (1496516.3481556983 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08954980855830245 = (121441.4156013484 - 110566.36008319841) / 121441.4156013484 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.623762188405799 < 14.40298757302778. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.21655746909577 (T) = (0 -10686121.928146841) / Math.Sqrt((3672041125568.171 / (299)) + (13996048001.333168 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.0880468942545836 = (11717841.47761871 - 10686121.928146841) / 11717841.47761871 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0946657704081633 < 1.481522200454613. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.925399559585545 (T) = (0 -1095525.4911436618) / Math.Sqrt((38315945433.34378 / (299)) + (118543625.86430904 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08508661098591591 = (1197408.961655055 - 1095525.4911436618) / 1197408.961655055 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 109.40109886532738 < 149.02139666927084. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.081937695471966 (T) = (0 -110626.96483968208) / Math.Sqrt((378592710.6818987 / (299)) + (1279394.8125215902 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08526063099900047 = (120938.23507399647 - 110626.96483968208) / 120938.23507399647 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.05077112781955 < 16.876387119487177. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.084711257395456 (T) = (0 -12989673.680417387) / Math.Sqrt((4125985066541.5522 / (299)) + (14701493828.027697 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07658283021628383 = (14066961.39672153 - 12989673.680417387) / 14066961.39672153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.1096538214285714 < 1.496609783481284. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.86120643592459 (T) = (0 -1118725.2842877689) / Math.Sqrt((37735747434.38699 / (299)) + (78808732.17220585 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08212958237435039 = (1218827.0400757564 - 1118725.2842877689) / 1218827.0400757564 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 113.30480380695444 < 150.73503091406246. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.950219612355427 (T) = (0 -112034.22725027238) / Math.Sqrt((395056407.5933026 / (299)) + (833227.1172917078 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08454529431104431 = (122380.9616729834 - 112034.22725027238) / 122380.9616729834 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 116.46472916666666 < 156.30103794391025. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.154149176263147 (T) = (0 -118029.68967178905) / Math.Sqrt((391885981.3065373 / (299)) + (2235423.927224548 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08270147017643178 = (128670.96788489424 - 118029.68967178905) / 128670.96788489424 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 115.34062052696078 < 153.4682877371604. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.014860467773117 (T) = (0 -114925.51939450916) / Math.Sqrt((379991993.23521394 / (299)) + (1288979.5403822202 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08191695561183564 = (125179.87353867173 - 114925.51939450916) / 125179.87353867173 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 135.3342656634852 < 173.3720240535559. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.03157797665261 (T) = (0 -134513.34155671572) / Math.Sqrt((458158051.8113514 / (299)) + (2446155.1675482835 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07775522429076322 = (145854.27329015825 - 134513.34155671572) / 145854.27329015825 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.0742959095238096 < 1.4512348587466857. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.170480220200492 (T) = (0 -1074257.9515636778) / Math.Sqrt((36604333066.83885 / (299)) + (151881571.4922893 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08716912428567511 = (1176842.2608657163 - 1074257.9515636778) / 1176842.2608657163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.056069065 < 1.4376056496088288. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.283936951166332 (T) = (0 -1067158.2054996742) / Math.Sqrt((37534921876.33672 / (299)) + (70721939.9733747 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08922194783403678 = (1171699.5188474471 - 1067158.2054996742) / 1171699.5188474471 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.024576396103898 < 14.786220336547622. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.703921463193911 (T) = (0 -11029752.269149262) / Math.Sqrt((3835890269496.8926 / (299)) + (19612244124.503437 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.08308613006298338 = (12029213.027290015 - 11029752.269149262) / 12029213.027290015 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2945330631944447 < 1.6743504088541667. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.225241193479913 (T) = (0 -1277816.5696464565) / Math.Sqrt((41329441472.221565 / (299)) + (98507646.20979469 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07870422804978228 = (1386977.568497409 - 1277816.5696464565) / 1386977.568497409 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json4KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 110.99881320921986 < 149.98868303864018. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.831361971764217 (T) = (0 -111728.92202958335) / Math.Sqrt((406388415.4705721 / (299)) + (1134134.137306708 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08494827415412969 = (122101.20900684774 - 111728.92202958335) / 122101.20900684774 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.726039321428573 < 16.695468809084247. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.14201130800432 (T) = (0 -12806589.445192253) / Math.Sqrt((4118706985972.9683 / (299)) + (16206408764.090763 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07806385781868327 = (13890972.334473886 - 12806589.445192253) / 13890972.334473886 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.702676891304348 < 14.586393802512818. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.226016253865822 (T) = (0 -10782581.4487829) / Math.Sqrt((3714839381898.8687 / (299)) + (23640957509.206646 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.08840626553387919 = (11828275.075955596 - 10782581.4487829) / 11828275.075955596 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json40KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 1.2963644854166667 < 1.685813377062665. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.052476902267456 (T) = (0 -1296094.0147644503) / Math.Sqrt((41847351985.01245 / (299)) + (183283509.38089314 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.07715561335105257 = (1404455.6520204397 - 1296094.0147644503) / 1404455.6520204397 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 11.250124084848487 < 15.02276000522222. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.552257423562876 (T) = (0 -11276175.496434327) / Math.Sqrt((3792830518183.1772 / (299)) + (12748087766.999725 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.07936964474234016 = (12248320.329692395 - 11276175.496434327) / 12248320.329692395 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.Text.Json.Document.Tests.Perf_EnumerateArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20ArrayOfStrings).html>) 201.24 μs 145.87 μs 0.72 0.05 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20ArrayOfNumbers).html>) 276.06 μs 194.87 μs 0.71 0.07 False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20ArrayOfNumbers).html>) 51.70 μs 40.01 μs 0.77 0.19 False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20ArrayOfNumbers).html>) 52.89 μs 40.59 μs 0.77 0.19 False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20ArrayOfStrings).html>) 55.63 μs 41.37 μs 0.74 0.18 False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20ArrayOfStrings).html>) 51.61 μs 40.08 μs 0.78 0.19 False
[EnumerateUsingIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase%3a%20Json400KB).html>) 5.13 ms 3.61 ms 0.70 0.14 False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase%3a%20Json400KB).html>) 21.34 ms 16.04 ms 0.75 0.02 False
[EnumerateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase%3a%20Json400KB).html>) 55.93 μs 42.44 μs 0.76 0.17 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateArray*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 145.8718885597463 < 189.56688011867092. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 7.784119796184113 (T) = (0 -146663.69000746234) / Math.Sqrt((574084442.4133718 / (299)) + (4201233.246357182 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.06975989868978888 = (157662.1882897669 - 146663.69000746234) / 157662.1882897669 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 194.86829314024388 < 262.2956360416666. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 6.340304883234238 (T) = (0 -201918.29365585654) / Math.Sqrt((1186906704.6924005 / (299)) + (11243295.974161755 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.06025998360111286 = (214866.1226853079 - 201918.29365585654) / 214866.1226853079 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.00618461134454 < 50.83821055723823. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.248356309028559 (T) = (0 -40797.84780801769) / Math.Sqrt((17438321.081536055 / (299)) + (1745033.2946777279 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.10084664597232688 = (45373.625783930576 - 40797.84780801769) / 45373.625783930576 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: ArrayOfNumbers) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.59334074312715 < 50.19385127478174. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.843238611966996 (T) = (0 -41014.56140383415) / Math.Sqrt((18559892.430975493 / (299)) + (1302607.935711447 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.11275606077140933 = (46226.92766940063 - 41014.56140383415) / 46226.92766940063 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 41.37160558487247 < 50.24734645420967. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 17.164229205251633 (T) = (0 -41036.698592053835) / Math.Sqrt((17525446.13028596 / (299)) + (1531750.4822358163 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.10981013943213806 = (46098.81600524642 - 41036.698592053835) / 46098.81600524642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: ArrayOfStrings) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 40.07618029092071 < 49.15289219895526. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 15.38211314155007 (T) = (0 -40607.79946569664) / Math.Sqrt((22248430.062159017 / (299)) + (1187664.6950546142 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.10485069521997782 = (45364.27526542712 - 40607.79946569664) / 45364.27526542712 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 3.6132030741071435 < 4.809455414058207. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 9.708865395613898 (T) = (0 -3709691.8485232606) / Math.Sqrt((360630722066.1863 / (299)) + (19496021212.450016 / (55))) is greater than 1.966726229870767 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (55) - 2, .975) and 0.09370161675789442 = (4093234.5429686876 - 3709691.8485232606) / 4093234.5429686876 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.Parse(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 16.039688764444442 < 20.293008710000002. IsChangePoint: Marked as a change because one of 5/25/2022 7:30:00 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 8.769866985569152 (T) = (0 -16248066.052368525) / Math.Sqrt((5739728663810.536 / (299)) + (22281976998.159847 / (56))) is greater than 1.966707008688054 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (56) - 2, .975) and 0.07024641612818368 = (17475669.18183412 - 16248066.052368525) / 17475669.18183412 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: Json400KB) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 42.436154081312715 < 53.289312742621085. IsChangePoint: Marked as a change because one of 5/25/2022 12:28:02 PM, 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 12.829987336729179 (T) = (0 -43547.14373021592) / Math.Sqrt((23818959.860917974 / (299)) + (3228763.3606550936 / (54))) is greater than 1.9667455609476752 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (54) - 2, .975) and 0.09911746547621188 = (48338.31499823137 - 43547.14373021592) / 48338.31499823137 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline cb3bd225a88dd75ad804a3701a2ac9b2553a4973
Compare 6a56aa3512c912df602bf074dc925b77f3895b24
Diff Diff

Improvements in System.IO.Tests.StringReaderReadToEndTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>) 419.76 ns 374.21 ns 0.89 0.02 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>) 413.76 ns 366.16 ns 0.88 0.08 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>) 294.23 ns 261.33 ns 0.89 0.05 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>) 418.34 ns 366.28 ns 0.88 0.06 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>) 275.28 ns 252.82 ns 0.92 0.02 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>) 272.64 ns 256.41 ns 0.94 0.05 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>) 434.56 ns 371.12 ns 0.85 0.03 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>) 413.23 ns 361.90 ns 0.88 0.05 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>) 419.26 ns 369.76 ns 0.88 0.02 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>) 283.31 ns 256.94 ns 0.91 0.03 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>) 420.49 ns 369.12 ns 0.88 0.06 False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>) 415.54 ns 372.02 ns 0.90 0.03 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>) 275.11 ns 260.38 ns 0.95 0.06 False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>) 282.18 ns 254.11 ns 0.90 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadToEndTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 374.2138590194967 < 393.4324537664806. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 47.07275070696598 (T) = (0 -373.581984413207) / Math.Sqrt((34.003979013538675 / (154)) + (33.21796031710738 / (55))) is greater than 1.9714903918671234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (55) - 2, .975) and 0.10268234099897493 = (416.33192065908094 - 373.581984413207) / 416.33192065908094 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 366.1556926377203 < 392.01306768197355. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 36.35341263471508 (T) = (0 -373.92348137826787) / Math.Sqrt((45.879112176422574 / (154)) + (57.093073913770745 / (56))) is greater than 1.9714346585199862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (56) - 2, .975) and 0.10038811741653907 = (415.6497803302163 - 373.92348137826787) / 415.6497803302163 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 261.33271763912546 < 270.2715945859769. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 24.268490218109996 (T) = (0 -255.97834587414937) / Math.Sqrt((31.936601617437162 / (154)) + (19.325231048612718 / (55))) is greater than 1.9714903918671234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (55) - 2, .975) and 0.06617773355332493 = (274.11891434992543 - 255.97834587414937) / 274.11891434992543 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 366.27598861425656 < 396.9102437249052. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 36.5177544755162 (T) = (0 -374.0049349526752) / Math.Sqrt((44.811877436946894 / (154)) + (58.81605399797605 / (56))) is greater than 1.9714346585199862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (56) - 2, .975) and 0.10159187520891262 = (416.29736489710064 - 374.0049349526752) / 416.29736489710064 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 252.81984220748308 < 261.63655057144126. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 29.98844837577447 (T) = (0 -255.29419948464485) / Math.Sqrt((21.64400997482884 / (154)) + (14.386640838213575 / (55))) is greater than 1.9714903918671234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (55) - 2, .975) and 0.06932492436164785 = (274.31077308000107 - 255.29419948464485) / 274.31077308000107 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.4126331209835 < 261.0296808000536. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 21.77528971549902 (T) = (0 -255.88873884647978) / Math.Sqrt((24.522983849719658 / (154)) + (27.892958988059817 / (56))) is greater than 1.9714346585199862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (56) - 2, .975) and 0.0645400457299262 = (273.54323151774696 - 255.88873884647978) / 273.54323151774696 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 371.12087446905025 < 394.51561611752385. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 49.16997907237923 (T) = (0 -372.14934877583744) / Math.Sqrt((45.49657713757938 / (153)) + (27.400289477878378 / (55))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (153) + (55) - 2, .975) and 0.10542277150365956 = (416.0058370828068 - 372.14934877583744) / 416.0058370828068 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 361.8993433430743 < 395.81001593351937. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 46.21417908763688 (T) = (0 -371.8225280583415) / Math.Sqrt((54.48413591764584 / (153)) + (32.352254998999385 / (54))) is greater than 1.9716034992643237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (153) + (54) - 2, .975) and 0.10831820219843381 = (416.9901516158194 - 371.8225280583415) / 416.9901516158194 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 369.7580596590909 < 392.7482101236189. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 46.33988022777567 (T) = (0 -372.2299515587241) / Math.Sqrt((43.71748220473496 / (154)) + (34.07620644074881 / (56))) is greater than 1.9714346585199862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (56) - 2, .975) and 0.10522808928409531 = (416.0054055126785 - 372.2299515587241) / 416.0054055126785 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 256.94102590508675 < 262.4207395847931. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 23.313355621914397 (T) = (0 -255.96436273648962) / Math.Sqrt((22.90488522921817 / (154)) + (24.14487629607907 / (55))) is greater than 1.9714903918671234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (55) - 2, .975) and 0.06526818337420132 = (273.8372206698511 - 255.96436273648962) / 273.8372206698511 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 369.1231136963584 < 399.7552054418352. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 42.63664823355392 (T) = (0 -372.9587660639905) / Math.Sqrt((52.52454792417919 / (153)) + (39.18969387556511 / (55))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (153) + (55) - 2, .975) and 0.10512005334049351 = (416.76960966239847 - 372.9587660639905) / 416.76960966239847 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 372.02208333413785 < 394.7071359617654. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 38.84484810920247 (T) = (0 -373.0390227642013) / Math.Sqrt((40.86872515666159 / (154)) + (50.10137300217633 / (54))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (54) - 2, .975) and 0.10212854310335283 = (415.470410490108 - 373.0390227642013) / 415.470410490108 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 260.3750794932943 < 264.16054201513003. IsChangePoint: Marked as a change because one of 6/5/2022 6:02:14 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 26.75132816992594 (T) = (0 -255.28289962878125) / Math.Sqrt((40.712226656758155 / (154)) + (13.922901786233489 / (56))) is greater than 1.9714346585199862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (56) - 2, .975) and 0.06981469607213929 = (274.4430583355888 - 255.28289962878125) / 274.4430583355888 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 254.10506188628207 < 261.1114081227348. IsChangePoint: Marked as a change because one of 6/5/2022 9:07:46 PM, 6/14/2022 8:14:23 AM falls between 6/5/2022 6:02:14 PM and 6/14/2022 8:14:23 AM. IsImprovementStdDev: Marked as improvement because 30.279447573374878 (T) = (0 -254.81650190234546) / Math.Sqrt((29.570337766955337 / (154)) + (11.690011363783677 / (54))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (154) + (54) - 2, .975) and 0.07058681634086324 = (274.1692353653977 - 254.81650190234546) / 274.1692353653977 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)