[Perf] Alpine/x64: 202 Regressions on 9/7/2022 8:07:21 PM

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage

MIT License

9 stars 4 forks source link

[Perf] Alpine/x64: 202 Regressions on 9/7/2022 8:07:21 PM #8541

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.IO.Tests.StreamReaderReadToEndTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	56.45 ms	64.26 ms	1.14	0.00	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	60.35 ms	69.36 ms	1.15	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	55.58 ms	64.73 ms	1.16	0.01	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	55.10 ms	63.98 ms	1.16	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	56.15 ms	65.15 ms	1.16	0.01	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	59.84 ms	66.46 ms	1.11	0.00	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	59.96 ms	68.69 ms	1.15	0.01	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	58.70 ms	66.45 ms	1.13	0.00	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	60.12 ms	65.66 ms	1.09	0.00	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	60.65 ms	68.67 ms	1.13	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	56.40 ms	65.45 ms	1.16	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	56.43 ms	64.97 ms	1.15	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>)	56.46 ms	64.69 ms	1.15	0.00	False
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	56.14 ms	65.30 ms	1.16	0.01	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>)	59.73 ms	68.62 ms	1.15	0.01	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	60.26 ms	69.33 ms	1.15	0.01	False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadToEndTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.25681208333333 > 60.12822153500001. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -40.90694464412171 (T) = (0 -64791847.821082786) / Math.Sqrt((414074133185.7893 / (22)) + (534194117216.1333 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14320930255378253 = (56675402.899841815 - 64791847.821082786) / 56675402.899841815 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 69.36279885526316 > 62.435511834375. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -31.11562370228904 (T) = (0 -67421197.60288875) / Math.Sqrt((378948480547.58136 / (22)) + (1214747837431.4373 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13212435441806925 = (59552819.74085291 - 67421197.60288875) / 59552819.74085291 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.73307592307692 > 59.15306983990385. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -37.32162382905688 (T) = (0 -64562998.41937804) / Math.Sqrt((323262884047.08844 / (22)) + (855337427381.6735 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14430550099414952 = (56421120.376758665 - 64562998.41937804) / 56421120.376758665 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.98068573076923 > 59.052623844230766. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -41.5672285817221 (T) = (0 -64629649.06078815) / Math.Sqrt((294904206592.5917 / (22)) + (708190460310.1743 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14897832425446614 = (56249667.810508244 - 64629649.06078815) / 56249667.810508244 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.14779878571429 > 58.89531333894231. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -38.88739030726867 (T) = (0 -64833070.5647354) / Math.Sqrt((354497388817.0946 / (22)) + (733125064257.68 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14450538759920997 = (56647239.294114225 - 64833070.5647354) / 56647239.294114225 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 66.46489579166666 > 62.997853696875005. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -27.90265183072314 (T) = (0 -67032157.509138234) / Math.Sqrt((363504239952.3615 / (22)) + (1272763119772.2646 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1192100253822363 = (59892384.79725482 - 67032157.509138234) / 59892384.79725482 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.6870318125 > 62.81519987451923. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.685331577541238 (T) = (0 -67676115.63817614) / Math.Sqrt((282285918701.0294 / (22)) + (2446340584394.806 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13542325194870158 = (59604306.6072719 - 67676115.63817614) / 59604306.6072719 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 66.45118096428571 > 62.363993765. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.257012200712868 (T) = (0 -67079565.56805735) / Math.Sqrt((288215390692.84985 / (22)) + (1329588085431.9543 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12428365278146382 = (59664271.91403463 - 67079565.56805735) / 59664271.91403463 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.6608814375 > 62.59618768576922. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.47328837918006 (T) = (0 -67505611.64796886) / Math.Sqrt((436643369085.3972 / (22)) + (1304350568878.4307 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13061676586075766 = (59706890.68685064 - 67505611.64796886) / 59706890.68685064 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.6749120375 > 62.46088592019231. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -26.50341612687542 (T) = (0 -67157161.50701608) / Math.Sqrt((467204127830.1209 / (22)) + (1368600189921.9807 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12015332764072406 = (59953543.72464619 - 67157161.50701608) / 59953543.72464619 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.45238861538462 > 59.0621966775. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -28.725254886902263 (T) = (0 -64834391.65021919) / Math.Sqrt((454836438484.81885 / (22)) + (1658910370688.5972 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1478092442675961 = (56485336.71776556 - 64834391.65021919) / 56485336.71776556 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.9684595125 > 59.65740261519231. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -40.089526962325316 (T) = (0 -64699734.48848008) / Math.Sqrt((538489732679.2868 / (22)) + (390717140094.6883 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14045206921030176 = (56731656.01188393 - 64699734.48848008) / 56731656.01188393 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 1]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.686860775 > 58.7260892984375. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -45.895126961753164 (T) = (0 -64140882.51975438) / Math.Sqrt((178812466135.08032 / (22)) + (637274464248.2585 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14846096715897025 = (55849423.14445762 - 64140882.51975438) / 55849423.14445762 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.3013413125 > 58.885940109375. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.7965990514328 (T) = (0 -64747798.113608785) / Math.Sqrt((212534430279.86615 / (22)) + (5675930179390.504 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1609119396245592 = (55773220.951236255 - 64747798.113608785) / 55773220.951236255 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 9, 32]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.62336876315788 > 62.548564935576934. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -27.96692986799882 (T) = (0 -67316456.62064646) / Math.Sqrt((274334577926.89273 / (22)) + (1661617130302.9226 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12971050546546603 = (59587351.17977023 - 67316456.62064646) / 59587351.17977023 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 69.3258040125 > 63.111153140625. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.877037908913827 (T) = (0 -67451947.05752888) / Math.Sqrt((320409280530.329 / (22)) + (1308848637890.0554 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12719800403047593 = (59840371.27136821 - 67451947.05752888) / 59840371.27136821 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in PerfLabTests.CastingPerf2.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ObjScalarValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.ObjScalarValueType.html>)	515.93 μs	644.67 μs	1.25	0.18	False
[ObjInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.ObjInt.html>)	462.15 μs	577.40 μs	1.25	0.19	False
[IFooObjIsIFooInterAlia - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia.html>)	282.69 μs	351.83 μs	1.24	0.01	False
[ObjFooIsObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj.html>)	260.82 μs	474.38 μs	1.82	0.01	False
[IFooObjIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo.html>)	416.99 μs	477.42 μs	1.14	0.01	False
[IFooObjIsDescendantOfIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo.html>)	415.53 μs	477.02 μs	1.15	0.01	False
[IFooFooIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo.html>)	260.94 μs	474.40 μs	1.82	0.01	False
[FooObjCastIfIsa - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa.html>)	260.92 μs	367.62 μs	1.41	0.03	False
[ObjObjrefValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.ObjObjrefValueType.html>)	789.63 μs	895.32 μs	1.13	0.39	False
[FooObjIsFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo.html>)	347.93 μs	514.32 μs	1.48	0.00	False
[FooObjIsNull - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull.html>)	304.38 μs	348.99 μs	1.15	0.00	False
[FooObjIsDescendant - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant.html>)	327.48 μs	443.32 μs	1.35	0.08	False

graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### PerfLabTests.CastingPerf2.CastingPerf.ObjScalarValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 644.6735604999999 > 527.9170694362593. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -16.902139318790525 (T) = (0 -624521.4770418631) / Math.Sqrt((1334446813.7892787 / (22)) + (276669042.0161703 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2962170600759044 = (481803.1611197064 - 624521.4770418631) / 481803.1611197064 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjInt ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 577.3959126275511 > 485.42936581835943. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -35.05294861713301 (T) = (0 -585029.1319263179) / Math.Sqrt((241597725.85141996 / (22)) + (47701864.12049161 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2730767368794927 = (459539.5666095624 - 585029.1319263179) / 459539.5666095624 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 351.83108611111106 > 296.8598756768767. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -45.45310456268387 (T) = (0 -351325.2871969119) / Math.Sqrt((40653365.037466556 / (22)) + (179072.7906082753 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.21388267710528916 = (289422.77027521894 - 351325.2871969119) / 289422.77027521894 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 474.3781390151515 > 273.9895332421875. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -266.1617025430934 (T) = (0 -474386.61419170786) / Math.Sqrt((9371.037031741625 / (22)) + (16712486.728730224 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.8181076273224833 = (260923.2847729341 - 474386.61419170786) / 260923.2847729341 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 477.4234463541667 > 437.5328243009868. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -53.35477950568087 (T) = (0 -476186.98474677646) / Math.Sqrt((32420670.253853615 / (22)) + (588901.5745087432 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.15882779260866034 = (410921.266976884 - 476186.98474677646) / 410921.266976884 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 477.0240032552083 > 437.26182778618426. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -49.23252753272018 (T) = (0 -476075.8272803795) / Math.Sqrt((39293957.581269704 / (22)) + (372042.837852625 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16111481100494418 = (410016.15238060406 - 476075.8272803795) / 410016.15238060406 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 474.39797739898995 > 274.0585854387019. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -1038.6484400873542 (T) = (0 -473818.642617331) / Math.Sqrt((5975.873565811671 / (22)) + (1084741.0311418334 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.8155486476425672 = (260978.21351830458 - 473818.642617331) / 260978.21351830458 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 367.6205344967532 > 273.94851355769237. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -56.66563584244245 (T) = (0 -370128.45582270366) / Math.Sqrt((96861954.21820992 / (22)) + (1470473.212277472 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.47775723687728333 = (250466.34628894736 - 370128.45582270366) / 250466.34628894736 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.ObjObjrefValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 895.3205815972221 > 816.4929446875001. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -16.066416579966695 (T) = (0 -896469.3344641465) / Math.Sqrt((898223065.3500984 / (22)) + (223781283.37264344 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14417676179522548 = (783505.9794935676 - 896469.3344641465) / 783505.9794935676 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 514.3190316358024 > 365.2550114236111. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -882.925185445896 (T) = (0 -514377.4687897925) / Math.Sqrt((7936.890470053286 / (22)) + (914671.5414495206 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4784067846203527 = (347926.885983469 - 514377.4687897925) / 347926.885983469 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 348.9934183407738 > 319.63645895663836. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -567.474441856978 (T) = (0 -348690.09922373854) / Math.Sqrt((8306.602175253716 / (22)) + (148301.25226698013 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14536305549973938 = (304436.30737818737 - 348690.09922373854) / 304436.30737818737 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 443.3150581018518 > 343.539223058143. IsChangePoint: Marked as a change because one of 6/14/2022 6:55:13 PM, 7/6/2022 12:32:56 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -209.8299877334945 (T) = (0 -445742.9284691436) / Math.Sqrt((2638872.69405307 / (22)) + (5188352.359066438 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3625540814782543 = (327137.7881643793 - 445742.9284691436) / 327137.7881643793 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20Compiled).html>)	43.92 μs	70.73 μs	1.61	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aei%22%2c%20Options%3a%20Compiled).html>)	55.90 μs	71.44 μs	1.28	0.08	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20None).html>)	48.19 μs	65.70 μs	1.36	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes%22%2c%20Options%3a%20None).html>)	70.94 μs	97.57 μs	1.38	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20Compiled).html>)	43.19 μs	70.51 μs	1.63	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20NonBacktracking).html>)	105.24 μs	133.69 μs	1.27	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20None).html>)	87.68 μs	103.49 μs	1.18	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22zqj%22%2c%20Options%3a%20None).html>)	39.79 μs	66.23 μs	1.66	0.48	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cHolmes%22%2c%20Options%3a%20Compiled).html>)	73.24 μs	80.80 μs	1.10	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20NonBacktracking).html>)	39.80 μs	66.45 μs	1.67	0.52	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20None).html>)	40.10 μs	67.35 μs	1.68	0.53	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aei%22%2c%20Options%3a%20None).html>)	53.52 μs	80.52 μs	1.50	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20Compiled).html>)	44.08 μs	61.22 μs	1.39	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22zqj%22%2c%20Options%3a%20NonBacktracking).html>)	42.52 μs	67.26 μs	1.58	0.49	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20NonBacktracking).html>)	52.30 μs	79.08 μs	1.51	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20NonBacktracking).html>)	50.83 μs	78.17 μs	1.54	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22aqj%22%2c%20Options%3a%20Compiled).html>)	42.26 μs	57.62 μs	1.36	0.48	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20Compiled).html>)	43.55 μs	61.04 μs	1.40	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Holmes%22%2c%20Options%3a%20NonBacktracking).html>)	86.88 μs	104.15 μs	1.20	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-q%5d%5b%5eu-z%5d%7b13%7dx%22%2c%20Options%3a%20NonBacktracking).html>)	57.78 μs	63.72 μs	1.10	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%7cStreet%22%2c%20Options%3a%20Compiled).html>)	40.64 μs	45.64 μs	1.12	0.21	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%20Holmes%22%2c%20Options%3a%20None).html>)	47.09 μs	64.66 μs	1.37	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fm)%5eSherlock%20Holmes%7cSherlock%20Holmes%24%22%2c%20Options%3a%20NonBacktracking).html>)	52.12 μs	80.10 μs	1.54	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%22%2c%20Options%3a%20None).html>)	47.30 μs	73.10 μs	1.55	0.04	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20None).html>)	48.20 μs	75.41 μs	1.56	0.07	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sherlock%5cs%2bHolmes%22%2c%20Options%3a%20NonBacktracking).html>)	58.40 μs	74.87 μs	1.28	0.05	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22Sher%5ba-z%5d%2b%7cHol%5ba-z%5d%2b%22%2c%20Options%3a%20Compiled).html>)	73.96 μs	82.82 μs	1.12	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5ba-q%5d%5b%5eu-z%5d%7b13%7dx%22%2c%20Options%3a%20Compiled).html>)	34.93 μs	41.53 μs	1.19	0.31	False
[Count - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22The%22%2c%20Options%3a%20Compiled).html>)	66.97 μs	92.91 μs	1.39	0.07	False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 70.7324784785068 > 48.0519232749244. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.03865464573073 (T) = (0 -67629.70957185361) / Math.Sqrt((797332.8353019268 / (22)) + (22072565.307586856 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5024454477184465 = (45013.08827854841 - 67629.70957185361) / 45013.08827854841 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.43717076088865 > 58.62116518772242. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.49037353864921 (T) = (0 -76236.19589974382) / Math.Sqrt((1490799.5313138876 / (22)) + (21998346.061679926 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.39278879208866774 = (54736.36514939048 - 76236.19589974382) / 54736.36514939048 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.70304404261705 > 49.83900720333656. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.44768919416073 (T) = (0 -70099.2351483983) / Math.Sqrt((157821.35666745593 / (22)) + (23438512.31658865 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4681051635524999 = (47748.10203566968 - 70099.2351483983) / 47748.10203566968 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 97.57276621376813 > 74.44826772614795. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -2.5010537638155395 (T) = (0 -109093.92540222497) / Math.Sqrt((724213.8446160548 / (22)) + (5827027102.0845995 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.522613955665583 = (71649.10382982569 - 109093.92540222497) / 71649.10382982569 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 70.50804370307807 > 46.173570462611515. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.71010795814521 (T) = (0 -66986.77793332691) / Math.Sqrt((216079.1548654822 / (22)) + (23275963.757097766 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5406689853195651 = (43479.02019941846 - 66986.77793332691) / 43479.02019941846 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 133.68950627444588 > 109.29385004159768. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -25.74807718384795 (T) = (0 -129620.6793529257) / Math.Sqrt((1552511.8861114883 / (22)) + (22311218.131512184 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.23674892713139295 = (104807.59393386134 - 129620.6793529257) / 104807.59393386134 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 103.4916701353745 > 90.33716892427884. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.681044569334905 (T) = (0 -107329.31788486053) / Math.Sqrt((989327.5097764046 / (22)) + (21663270.10345159 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.23350260407215098 = (87011.82918506635 - 107329.31788486053) / 87011.82918506635 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 66.22671276924434 > 43.212702855665064. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.833845118360664 (T) = (0 -61044.030068795706) / Math.Sqrt((1670758.859084611 / (22)) + (19663420.44489388 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4843259298246228 = (41125.75873144534 - 61044.030068795706) / 41125.75873144534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Holmes", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 80.79626369201031 > 76.89234599819892. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -57.23836181224786 (T) = (0 -81139.98072019569) / Math.Sqrt((210738.8156519268 / (22)) + (217707.00511736583 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.10438387367462645 = (73470.81268962928 - 81139.98072019569) / 73470.81268962928 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 66.4472210578087 > 41.85738987092761. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.78013957907743 (T) = (0 -62203.602116872935) / Math.Sqrt((1860737.237535178 / (22)) + (21649572.388470337 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5045369626655002 = (41344.017236153806 - 62203.602116872935) / 41344.017236153806 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 67.35080458872126 > 43.26356678985879. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.188591224830326 (T) = (0 -62600.96756483764) / Math.Sqrt((1611513.2954260437 / (22)) + (21913300.090906434 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5134193957815354 = (41363.925782456536 - 62600.96756483764) / 41363.925782456536 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 80.52307879080756 > 56.22307336930531. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.906028297048493 (T) = (0 -75974.17648478426) / Math.Sqrt((1700597.8102037853 / (22)) + (22147442.761364296 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.38490629877453386 = (54858.71250063037 - 75974.17648478426) / 54858.71250063037 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.21948170689174 > 46.38587737007764. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.4110812491677 (T) = (0 -64870.57606195765) / Math.Sqrt((909321.0889444954 / (22)) + (21688721.30700932 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4776637975517777 = (43900.768340834016 - 64870.57606195765) / 43900.768340834016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 67.25874973060345 > 44.509217929054586. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.624399351435937 (T) = (0 -63366.807986084284) / Math.Sqrt((1641600.7096277082 / (22)) + (21697360.41058819 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5515368412282373 = (40841.31701050776 - 63366.807986084284) / 40841.31701050776 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 79.08074051978114 > 54.73475625064103. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.443685520377443 (T) = (0 -75183.79923697827) / Math.Sqrt((187817.3510928142 / (22)) + (23443227.108577058 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.44964900011281783 = (51863.45055329059 - 75183.79923697827) / 51863.45055329059 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 78.17135229910714 > 53.42699496181305. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.965565542041038 (T) = (0 -71231.5581811303) / Math.Sqrt((444015.09098438476 / (22)) + (20807755.9025743 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.41250458452259814 = (50429.25804393429 - 71231.5581811303) / 50429.25804393429 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.621081588104005 > 42.043892783310575. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.52807245669959 (T) = (0 -62248.24954681809) / Math.Sqrt((2515122.3409419954 / (22)) + (22372809.74226066 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5185098945893223 = (40992.98250779788 - 62248.24954681809) / 40992.98250779788 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.03598676347971 > 45.65326249388378. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -2.4513912661241943 (T) = (0 -79233.49050679505) / Math.Sqrt((177075.6587039936 / (22)) + (5676347661.550327 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.8421328838050491 = (43011.82135304645 - 79233.49050679505) / 43011.82135304645 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 104.14828150000001 > 90.14046110246848. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.116624558159792 (T) = (0 -109876.25771388286) / Math.Sqrt((1210771.9140650346 / (22)) + (24954560.19553345 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2689415801408615 = (86588.90167480036 - 109876.25771388286) / 86588.90167480036 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.71997963866831 > 60.29877347318535. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.41676488676595 (T) = (0 -63596.63486921789) / Math.Sqrt((1483569.0017458026 / (22)) + (572302.1749181676 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09482091817088045 = (58088.61870804306 - 63596.63486921789) / 58088.61870804306 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock|Street", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.63896657004832 > 42.598028992757484. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.458507448270472 (T) = (0 -45271.01516726109) / Math.Sqrt((1299632.4137796054 / (22)) + (99803.03732788737 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09367059914584376 = (41393.647413231854 - 45271.01516726109) / 41393.647413231854 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.66402564834026 > 49.141162798296975. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.42444004005127 (T) = (0 -68969.69880413836) / Math.Sqrt((216477.48717328947 / (22)) + (22896701.20258273 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.47166313057653453 = (46865.14010656704 - 68969.69880413836) / 46865.14010656704 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 80.09763478796845 > 54.70009950396911. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -31.572593232549067 (T) = (0 -77068.77269534297) / Math.Sqrt((167399.66096687497 / (22)) + (16404772.762385754 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.486692167887573 = (51839.09242277725 - 77068.77269534297) / 51839.09242277725 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 73.09666309085192 > 48.881919267887696. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.01997288977347 (T) = (0 -68849.88562099038) / Math.Sqrt((345584.4744873267 / (22)) + (24097430.392289005 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4806061617353415 = (46501.147570732115 - 68849.88562099038) / 46501.147570732115 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 75.41463653383877 > 51.669271374379704. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.160921832759232 (T) = (0 -71618.10998535453) / Math.Sqrt((878562.2740641802 / (22)) + (21316650.81392493 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4552171915321698 = (49214.72231230942 - 71618.10998535453) / 49214.72231230942 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\s+Holmes", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 74.86598993933698 > 60.110695259286054. IsChangePoint: Marked as a change because one of 7/14/2022 11:03:46 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.88255348494943 (T) = (0 -80560.0868312824) / Math.Sqrt((2315925.621442041 / (22)) + (21648607.92487284 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4027314084739215 = (57430.87118789649 - 80560.0868312824) / 57430.87118789649 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 82.82395259038802 > 77.80298397882109. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -94.97554222097011 (T) = (0 -83700.28910231042) / Math.Sqrt((92840.52678093695 / (22)) + (144121.69373766318 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.126277366875838 = (74315.87596800001 - 83700.28910231042) / 74315.87596800001 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "[a-q][^u-z]{13}x", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.52997602949491 > 36.91743696115945. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.741757491904814 (T) = (0 -41551.79786558617) / Math.Sqrt((1289477.882251671 / (22)) + (46627.533862959535 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16337377557357247 = (35716.636164589574 - 41551.79786558617) / 35716.636164589574 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 92.91006722844463 > 70.8575646767068. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.01256211134889 (T) = (0 -88234.4445629255) / Math.Sqrt((862719.2097402995 / (22)) + (21335516.61635107 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3009502442274008 = (67823.07390650867 - 88234.4445629255) / 67823.07390650867 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.CtorDefaultSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(String).LinkedList.html>)	4.46 ns	5.81 ns	1.30	0.25	False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(String).ConcurrentStack.html>)	3.85 ns	5.26 ns	1.37	0.28	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;String&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.CtorDefaultSize<String>.LinkedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.81052296315514 > 4.601673844170276. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -40.64133011720384 (T) = (0 -5.799038622485677) / Math.Sqrt((0.03389733866862527 / (22)) + (0.0007933161727195491 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3846693520004583 = (4.1880313261124 - 5.799038622485677) / 4.1880313261124 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<String>.ConcurrentStack ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.261945558284708 > 4.04804757431414. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.6373200709997 (T) = (0 -5.274593986510238) / Math.Sqrt((0.06078098336376292 / (22)) + (0.0006766306878701236 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4219246093013788 = (3.7094751381381297 - 5.274593986510238) / 3.7094751381381297 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorFromCollection(String).Dictionary(Size%3a%20512).html>)	3.63 μs	3.87 μs	1.07	0.03	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.CtorFromCollection<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.8730192202970293 > 3.844772191184346. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -27.251129945134252 (T) = (0 -3886.8505826315554) / Math.Sqrt((1874.9798162320706 / (22)) + (123.29370305391969 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07123904890249269 = (3628.369024274943 - 3886.8505826315554) / 3628.369024274943 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in PerfLabTests.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ObjFooIsObj2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjFooIsObj2.html>)	130.40 μs	234.55 μs	1.80	0.02	False
[ObjFooIsObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjFooIsObj.html>)	130.48 μs	233.68 μs	1.79	0.01	False
[FooObjIsFoo2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.FooObjIsFoo2.html>)	239.22 μs	326.06 μs	1.36	0.01	False
[IFooFooIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.IFooFooIsIFoo.html>)	130.51 μs	234.70 μs	1.80	0.01	False
[ScalarValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ScalarValueTypeObj.html>)	239.16 μs	343.97 μs	1.44	0.01	False
[FooObjCastIfIsa - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.FooObjCastIfIsa.html>)	396.00 μs	503.15 μs	1.27	0.02	False
[IFooObjIsDescendantOfIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.IFooObjIsDescendantOfIFoo.html>)	347.95 μs	531.09 μs	1.53	0.46	False
[ObjrefValueTypeObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjrefValueTypeObj.html>)	239.21 μs	337.97 μs	1.41	0.02	False
[ObjObjrefValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjObjrefValueType.html>)	130.53 μs	233.98 μs	1.79	0.01	False
[IntObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.IntObj.html>)	239.34 μs	338.49 μs	1.41	0.02	False
[ObjScalarValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjScalarValueType.html>)	130.42 μs	234.92 μs	1.80	0.01	False
[ObjInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.ObjInt.html>)	130.47 μs	234.60 μs	1.80	0.01	False
[FooObjIsNull - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.FooObjIsNull.html>)	130.46 μs	234.54 μs	1.80	0.01	False
[FooObjIsFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.CastingPerf.FooObjIsFoo.html>)	239.21 μs	343.10 μs	1.43	0.01	False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### PerfLabTests.CastingPerf.ObjFooIsObj2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 234.54919070273633 > 136.99286650390624. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -619.7025929998483 (T) = (0 -233894.37016446766) / Math.Sqrt((825.6996035946495 / (22)) + (723256.5465900055 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.792747769433293 = (130466.97039729365 - 233894.37016446766) / 130466.97039729365 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjFooIsObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 233.68443163646057 > 136.99545319070515. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -550.5059180226641 (T) = (0 -233797.69552005111) / Math.Sqrt((604.3720256224208 / (22)) + (915184.1241020131 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7919070717931227 = (130474.23005373533 - 233797.69552005111) / 130474.23005373533 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsFoo2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 326.0576237980769 > 251.160515081403. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -2489.5259216502604 (T) = (0 -326224.87025542103) / Math.Sqrt((5658.316464491408 / (22)) + (25069.4981021373 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.36370621974869327 = (239219.31683756525 - 326224.87025542103) / 239219.31683756525 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.IFooFooIsIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 234.70067272727275 > 136.99573145833335. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -637.1005312860673 (T) = (0 -233931.210129982) / Math.Sqrt((1011.3492370253045 / (22)) + (684450.795118152 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7929679480899547 = (130471.49581184007 - 233931.210129982) / 130471.49581184007 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ScalarValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 343.9666591485508 > 251.18333664772732. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -265.1619822438182 (T) = (0 -343087.11477876024) / Math.Sqrt((4395.998711223614 / (22)) + (3985046.1904896284 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.43425687689357345 = (239208.97316653997 - 343087.11477876024) / 239208.97316653997 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjCastIfIsa ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 503.15123156682023 > 415.8750122748397. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -25.50748411014781 (T) = (0 -503139.169100488) / Math.Sqrt((599018716.6002557 / (22)) + (3043588.8791112965 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.36074087790509357 = (369753.8431233783 - 503139.169100488) / 369753.8431233783 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.IFooObjIsDescendantOfIFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 531.0922150000001 > 365.37166161057695. IsChangePoint: Marked as a change because one of 9/8/2022 3:28:14 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -3.153925628709786 (T) = (0 -507061.75139699987) / Math.Sqrt((5900494905.320311 / (28)) + (17195339905.527157 / (20))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (20) - 2, .025) and -0.2555070412114599 = (403870.0976999121 - 507061.75139699987) / 403870.0976999121 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjrefValueTypeObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 337.96749468085096 > 251.1849096661932. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -264.8935165771378 (T) = (0 -342440.0678377359) / Math.Sqrt((5121.247219454128 / (22)) + (3939924.1284453417 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.43134057217686167 = (239244.2962173106 - 342440.0678377359) / 239244.2962173106 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjObjrefValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 233.98292557302776 > 137.00610918098957. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -706.6590455590034 (T) = (0 -233957.67642566984) / Math.Sqrt((750.3433966476715 / (22)) + (556535.0811461605 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7929510428263756 = (130487.4872974017 - 233957.67642566984) / 130487.4872974017 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.IntObj ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 338.4928348214285 > 251.17759389204548. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -89.55909865718586 (T) = (0 -339794.7308881625) / Math.Sqrt((21723440.872857954 / (22)) + (6460451.409762884 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.41445216941439866 = (240230.62655334742 - 339794.7308881625) / 240230.62655334742 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjScalarValueType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 234.92019040404037 > 136.99239427734375. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -418.9257569990958 (T) = (0 -234425.02697927348) / Math.Sqrt((892.4460250860387 / (22)) + (1600362.4630060869 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7969617824242611 = (130456.3231517441 - 234425.02697927348) / 130456.3231517441 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.ObjInt ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 234.6013157960199 > 136.99115481244993. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -750.1325049664797 (T) = (0 -234411.73689141433) / Math.Sqrt((1067.2170443845218 / (22)) + (497995.18266384775 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7967479460039508 = (130464.45240845089 - 234411.73689141433) / 130464.45240845089 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsNull ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 234.5363956778607 > 136.98453288726668. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -555.2885410759706 (T) = (0 -233933.3719432996) / Math.Sqrt((1192.0177880806152 / (22)) + (901343.496508973 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.7931023112851724 = (130462.92477066311 - 233933.3719432996) / 130462.92477066311 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.CastingPerf.FooObjIsFoo ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 343.1008125 > 251.18549308263854. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -246.4668771745099 (T) = (0 -342026.31116303575) / Math.Sqrt((4822.18479448196 / (22)) + (4517767.376160078 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4297390674017781 = (239222.88965957257 - 342026.31116303575) / 239222.88965957257 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.Sort<IntClass>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[Array_ComparerStruct - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Sort(IntClass).Array_ComparerStruct(Size%3a%20512).html>)	39.33 μs	45.07 μs	1.15	0.31	False
[Array_Comparison - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Sort(IntClass).Array_Comparison(Size%3a%20512).html>)	36.00 μs	41.48 μs	1.15	0.18	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Sort(IntClass).List(Size%3a%20512).html>)	32.95 μs	36.99 μs	1.12	0.01	False

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort&lt;IntClass&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.Sort<IntClass>.Array_ComparerStruct(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.073870533333334 > 41.36159593211537. IsChangePoint: Marked as a change because one of 7/13/2022 11:09:36 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -8.984288981879002 (T) = (0 -43801.86715633136) / Math.Sqrt((2144828.238363084 / (22)) + (1223573.8645202136 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08457960769075931 = (40386.032381332 - 43801.86715633136) / 40386.032381332 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntClass>.Array_Comparison(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.48300635714286 > 38.02108428500001. IsChangePoint: Marked as a change because one of 6/13/2022 9:13:09 AM, 6/21/2022 5:13:43 PM, 7/13/2022 4:52:15 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -12.037554597203071 (T) = (0 -40022.22995404481) / Math.Sqrt((741342.8793563423 / (22)) + (1657141.8795715154 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.10361141682949024 = (36264.78427436231 - 40022.22995404481) / 36264.78427436231 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Sort<IntClass>.List(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.985216507692314 > 34.63371880500001. IsChangePoint: Marked as a change because one of 6/13/2022 4:43:40 AM, 6/23/2022 8:35:19 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.36249045271823 (T) = (0 -36622.648135548035) / Math.Sqrt((108415.41381049422 / (22)) + (505055.6320123808 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11055754541735009 = (32976.812670959036 - 36622.648135548035) / 32976.812670959036 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[BitArrayIntArrayCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Perf_BitArray.BitArrayIntArrayCtor(Size%3a%204).html>)	13.58 ns	14.63 ns	1.08	0.14	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%20512).html>)	11.85 ns	14.19 ns	1.20	0.14	False
[BitArrayLengthCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size%3a%204).html>)	10.17 ns	12.00 ns	1.18	0.17	False
[BitArrayLengthValueCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size%3a%20512).html>)	15.34 ns	17.17 ns	1.12	0.09	False
[BitArrayBitArrayCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Perf_BitArray.BitArrayBitArrayCtor(Size%3a%20512).html>)	15.45 ns	16.92 ns	1.10	0.14	False

graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.Tests.Perf_BitArray.BitArrayIntArrayCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.629501826236275 > 14.039731273276523. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.270526118324938 (T) = (0 -14.814960799192452) / Math.Sqrt((0.06688936929225378 / (22)) + (0.06046153921239832 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09930944808838903 = (13.476606450489879 - 14.814960799192452) / 13.476606450489879 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.191649994569673 > 12.5244807684791. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.662395759950456 (T) = (0 -13.960888965952591) / Math.Sqrt((0.14910914892070087 / (22)) + (0.050832118161418915 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13407728351985174 = (12.310350598525334 - 13.960888965952591) / 12.310350598525334 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthCtor(Size: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.9991900112145 > 10.662123150471071. IsChangePoint: Marked as a change because one of 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.418795100523223 (T) = (0 -12.14854617237374) / Math.Sqrt((0.16100781737595216 / (22)) + (0.03256870760406089 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16328370850078208 = (10.443321851408506 - 12.14854617237374) / 10.443321851408506 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayLengthValueCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.170975409873034 > 16.103100468702255. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -11.065301488299916 (T) = (0 -16.562082518063153) / Math.Sqrt((0.031469437349435345 / (22)) + (0.3029090166928718 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08273457968628382 = (15.296530496755652 - 16.562082518063153) / 15.296530496755652 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.Tests.Perf_BitArray.BitArrayBitArrayCtor(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.923859273317863 > 16.082383967411797. IsChangePoint: Marked as a change because one of 7/6/2022 12:32:56 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -5.020211054528917 (T) = (0 -16.93976840389556) / Math.Sqrt((1.1014179367613908 / (22)) + (0.1647909316120767 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07571110493552408 = (15.747507231424272 - 16.93976840389556) / 15.747507231424272 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Xml.Linq.Perf_XName

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[NonEmptyNameSpaceToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Xml.Linq.Perf_XName.NonEmptyNameSpaceToString.html>)	17.54 ns	21.57 ns	1.23	0.05	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Linq.Perf_XName*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Xml.Linq.Perf_XName.NonEmptyNameSpaceToString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.567112095874354 > 18.455210678896382. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 7/6/2022 12:32:56 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -79.23578735542728 (T) = (0 -21.51150633406312) / Math.Sqrt((0.0433566186595245 / (22)) + (0.009921729245552907 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.21750743305255738 = (17.66848049553921 - 21.51150633406312) / 17.66848049553921 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.IO.Tests.StringReaderReadToEndTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%208%5d).html>)	7.20 ns	8.26 ns	1.15	0.27	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%2033%2c%20%20128%5d).html>)	15.34 ns	16.36 ns	1.07	0.15	False
[ReadToEndAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>)	15.07 ns	16.34 ns	1.08	0.25	False

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadToEndTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 8]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.261985982731618 > 7.824740360601276. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -3.812565108600539 (T) = (0 -8.160416392416879) / Math.Sqrt((0.5365607161385274 / (22)) + (0.10010037096709878 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08520018214391839 = (7.519733710599996 - 8.160416392416879) / 7.519733710599996 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 33, 128]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.364800866874933 > 16.12620052797357. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -10.806411190622732 (T) = (0 -16.635171373474822) / Math.Sqrt((0.05237899027429571 / (22)) + (0.37143104605791166 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09154170473540965 = (15.240069436932048 - 16.635171373474822) / 15.240069436932048 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 0, 0]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.33682379340629 > 16.008666835728643. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -6.217096498208639 (T) = (0 -16.69264469826757) / Math.Sqrt((0.2885802090675933 / (22)) + (0.7756853574559347 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08364454822237118 = (15.404169868847186 - 16.69264469826757) / 15.404169868847186 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[Substring_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Substring_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%2010%2c%20i2%3a%201).html>)	7.00 ns	8.72 ns	1.25	0.12	False
[Remove_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Remove_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%200%2c%20i2%3a%208).html>)	9.31 ns	11.38 ns	1.22	0.13	False
[PadLeft - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.PadLeft(n%3a%2018).html>)	9.67 ns	10.92 ns	1.13	0.18	False
[Remove_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Remove_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%2010%2c%20i2%3a%201).html>)	9.95 ns	11.49 ns	1.15	0.10	False
[Substring_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Substring_Int(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i%3a%207).html>)	7.64 ns	8.99 ns	1.18	0.14	False
[Remove_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Remove_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%207%2c%20i2%3a%204).html>)	9.96 ns	11.43 ns	1.15	0.17	False
[Interpolation_MultipleArgs - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Interpolation_MultipleArgs(c%3a%20%271%27%2c%20s%3a%20%22Foo%22).html>)	66.18 ns	88.26 ns	1.33	0.23	False
[GetChars - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.GetChars(size%3a%20100).html>)	14.56 ns	15.73 ns	1.08	0.06	False
[CtorCharCount - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.CtorCharCount(size%3a%201).html>)	8.03 ns	9.82 ns	1.22	0.10	False
[Insert - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Insert(s1%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i%3a%207%2c%20s2%3a%20%22Test%22).html>)	13.62 ns	14.73 ns	1.08	0.08	False
[Concat_str_str - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Concat_str_str(size%3a%20100).html>)	25.70 ns	27.22 ns	1.06	0.11	False
[Replace_Char - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Replace_Char(text%3a%20%22Hello%22%2c%20oldChar%3a%20%27l%27%2c%20newChar%3a%20%27!%27).html>)	12.65 ns	15.50 ns	1.22	0.05	False
[Insert - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Insert(s1%3a%20%22Test%22%2c%20i%3a%202%2c%20s2%3a%20%22%20Test%22).html>)	12.80 ns	13.87 ns	1.08	0.09	False
[Trim_CharArr - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Trim_CharArr(s%3a%20%22%20Test%22%2c%20c%3a%20%5b%27%20%27%2c%20%27%e2%80%85%27%5d).html>)	12.45 ns	13.68 ns	1.10	0.08	False
[TrimStart_CharArr - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.TrimStart_CharArr(s%3a%20%22%20Test%22%2c%20c%3a%20%5b%27%20%27%2c%20%27%e2%80%85%27%5d).html>)	11.28 ns	13.03 ns	1.16	0.05	False
[Substring_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_String.Substring_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%207%2c%20i2%3a%204).html>)	7.35 ns	8.61 ns	1.17	0.13	False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_String*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_String.Substring_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 10, i2: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.724337479241017 > 7.070644915082623. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.393372020611608 (T) = (0 -8.76300806428252) / Math.Sqrt((0.2940897072601981 / (22)) + (0.003594146392515099 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2998341466863984 = (6.74163552836461 - 8.76300806428252) / 6.74163552836461 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 0, i2: 8) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.376223479711978 > 9.80208718648191. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -51.74135396181304 (T) = (0 -11.386654417911636) / Math.Sqrt((0.031498406087093755 / (22)) + (0.004292773003049982 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.221870282883947 = (9.319037034795565 - 11.386654417911636) / 9.319037034795565 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.PadLeft(n: 18) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.924671491283362 > 10.090461801741586. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.307348884683297 (T) = (0 -11.055866052650957) / Math.Sqrt((0.047103165519293444 / (22)) + (0.05229446748912025 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14179960155825266 = (9.682842801453637 - 11.055866052650957) / 9.682842801453637 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 10, i2: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.485095326853125 > 10.432885119005617. IsChangePoint: Marked as a change because one of 7/6/2022 12:32:56 PM, 7/27/2022 9:27:06 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.26490764599488 (T) = (0 -11.56369600679429) / Math.Sqrt((0.005067414272393898 / (22)) + (0.10999397720309316 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16299305729978575 = (9.94304818434828 - 11.56369600679429) / 9.94304818434828 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Substring_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 7) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.994306771002632 > 8.042685172892256. IsChangePoint: Marked as a change because one of 7/5/2022 3:17:18 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -9.493073997591523 (T) = (0 -9.031666461465337) / Math.Sqrt((0.2767712711469876 / (22)) + (0.06153443396691034 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14745319512094915 = (7.871054348768744 - 9.031666461465337) / 7.871054348768744 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 7, i2: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.42778524022452 > 10.236561513488287. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -12.069878593613302 (T) = (0 -11.449541290111059) / Math.Sqrt((0.3509313170182537 / (22)) + (0.05174653984853256 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16442058173985608 = (9.83282283880912 - 11.449541290111059) / 9.83282283880912 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Interpolation_MultipleArgs(c: '1', s: "Foo") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 88.26162964272399 > 70.31754674477041. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.158597482480126 (T) = (0 -86.60218980722938) / Math.Sqrt((7.416247977950447 / (22)) + (14.443697561229687 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.30010383114301326 = (66.61174879477993 - 86.60218980722938) / 66.61174879477993 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.GetChars(size: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.730189937990428 > 14.944084032712388. IsChangePoint: Marked as a change because one of 7/13/2022 1:49:45 PM, 7/27/2022 9:27:06 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.61149957837247 (T) = (0 -15.887232443613613) / Math.Sqrt((0.06889475060140117 / (22)) + (0.052093828450721864 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.10800849986197952 = (14.338547443988585 - 15.887232443613613) / 14.338547443988585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.CtorCharCount(size: 1) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.822586942741621 > 8.401622340187005. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -52.297956835867424 (T) = (0 -9.794183682618613) / Math.Sqrt((0.0033846864711836256 / (22)) + (0.026663086846042305 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.22455113864586893 = (7.9981826593613725 - 9.794183682618613) / 7.9981826593613725 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Insert(s1: "dzsdzsDDZSDZSDZSddsz", i: 7, s2: "Test") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.73012781408889 > 13.709243267607254. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -16.67682490020886 (T) = (0 -14.661996762247806) / Math.Sqrt((0.15319108232886944 / (22)) + (0.060243320874652395 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12305582511899789 = (13.055447854245568 - 14.661996762247806) / 13.055447854245568 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Concat_str_str(size: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.222104495432973 > 26.95206919630539. IsChangePoint: Marked as a change because one of 7/7/2022 1:55:17 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.591073946886933 (T) = (0 -27.894724863831602) / Math.Sqrt((0.07290260761712554 / (22)) + (0.13567612749207436 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08085550115461762 = (25.808005634456432 - 27.894724863831602) / 25.808005634456432 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Replace_Char(text: "Hello", oldChar: 'l', newChar: '!') ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.495080332046022 > 13.297079205983593. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -67.71907173898262 (T) = (0 -15.466784149876396) / Math.Sqrt((0.009245045280036711 / (22)) + (0.029875760497092486 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.20984187726523035 = (12.784136869884241 - 15.466784149876396) / 12.784136869884241 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Insert(s1: "Test", i: 2, s2: " Test") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.866365364117495 > 13.239920657685355. IsChangePoint: Marked as a change because one of 7/1/2022 12:02:05 PM, 7/1/2022 7:34:46 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -10.394631839692286 (T) = (0 -13.693364281910238) / Math.Sqrt((0.38169928712216733 / (22)) + (0.09307361920992446 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12336806584866881 = (12.189561638967668 - 13.693364281910238) / 12.189561638967668 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Trim_CharArr(s: " Test", c: [' ', ' ']) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.684987442583948 > 12.996102306794013. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 7/26/2022 6:20:16 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.83459158684873 (T) = (0 -13.625808974500309) / Math.Sqrt((0.07306510826134327 / (22)) + (0.032088027887110286 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12753165859294788 = (12.084635380885022 - 13.625808974500309) / 12.084635380885022 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.TrimStart_CharArr(s: " Test", c: [' ', ' ']) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.034375965920347 > 11.79647422336215. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -30.353807130246025 (T) = (0 -13.07358748127783) / Math.Sqrt((0.037939017327331064 / (22)) + (0.028816331283021038 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14099796567416417 = (11.458028738511587 - 13.07358748127783) / 11.458028738511587 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_String.Substring_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 7, i2: 4) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.612993020289398 > 7.37453075600576. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.41768693467512 (T) = (0 -8.665201550884687) / Math.Sqrt((0.04125415944607891 / (22)) + (0.04467073618764388 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2555015216703974 = (6.901784984980315 - 8.665201550884687) / 6.901784984980315 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ToString_MultipleSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length%3a%20100).html>)	22.63 ns	24.35 ns	1.08	0.07	False
[Append_Char_Capacity - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length%3a%20100).html>)	123.98 ns	133.22 ns	1.07	0.06	False
[ctor_capacity - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.ctor_capacity(length%3a%20100000).html>)	6.19 μs	6.91 μs	1.12	0.05	False
[ToString_SingleSegment - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length%3a%20100).html>)	15.43 ns	16.60 ns	1.08	0.10	False
[Append_Char_Capacity - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length%3a%20100000).html>)	111.24 μs	118.21 μs	1.06	0.01	False
[Append_Char - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.Tests.Perf_StringBuilder.Append_Char(length%3a%20100000).html>)	110.19 μs	118.10 μs	1.07	0.01	False

graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.353116709007857 > 23.650082252713208. IsChangePoint: Marked as a change because one of 7/6/2022 12:32:56 PM, 7/27/2022 9:27:06 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.568966706364733 (T) = (0 -24.619009413607323) / Math.Sqrt((0.10707516658526477 / (22)) + (0.12143935293744666 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09356829646864909 = (22.512548592627486 - 24.619009413607323) / 22.512548592627486 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 133.21626157752294 > 129.5569069447784. IsChangePoint: Marked as a change because one of 7/12/2022 12:16:14 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.172124794772007 (T) = (0 -133.79309286883066) / Math.Sqrt((3.9044545432951403 / (22)) + (4.629449524994329 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08287166070846551 = (123.55397017343397 - 133.79309286883066) / 123.55397017343397 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.ctor_capacity(length: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.909357869975857 > 6.571513613005906. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.437846108444905 (T) = (0 -6866.21984736876) / Math.Sqrt((11613.025574486968 / (22)) + (6369.882679677049 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09504898582012951 = (6270.239903675498 - 6866.21984736876) / 6270.239903675498 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.60181710996536 > 16.10954721287486. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.999651458336391 (T) = (0 -16.880292519964694) / Math.Sqrt((0.11252412599842615 / (22)) + (0.058527622376979054 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0885500434762877 = (15.507135038144348 - 16.880292519964694) / 15.507135038144348 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 118.2099110745614 > 116.72535925088651. IsChangePoint: Marked as a change because one of 7/12/2022 12:16:14 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -210.87209625674845 (T) = (0 -118181.69188626515) / Math.Sqrt((14835.401361358652 / (22)) + (11571.970777438299 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0634887591038024 = (111126.41377221173 - 118181.69188626515) / 111126.41377221173 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 118.09782696697101 > 115.57425132042256. IsChangePoint: Marked as a change because one of 7/12/2022 12:16:14 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -138.24190906667755 (T) = (0 -118180.50005578379) / Math.Sqrt((69540.97984785865 / (22)) + (6009.018954184269 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07310886984964604 = (110129.08696984504 - 118180.50005578379) / 110129.08696984504 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Reflection.Activator<EmptyStruct>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CreateInstanceType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Reflection.Activator(EmptyStruct).CreateInstanceType.html>)	8.55 ns	9.80 ns	1.15	0.25	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Activator&lt;EmptyStruct&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Reflection.Activator<EmptyStruct>.CreateInstanceType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.800937227207234 > 8.955555148314001. IsChangePoint: Marked as a change because one of 6/16/2022 2:51:40 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -11.59514112548156 (T) = (0 -9.520140449835184) / Math.Sqrt((0.20501133280332745 / (22)) + (0.03665430718227389 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14436667073619627 = (8.31913467360131 - 9.520140449835184) / 8.31913467360131 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Object

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Object.ctor.html>)	3.26 ns	4.49 ns	1.38	0.45	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Object*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Object.ctor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.488466591503933 > 3.2048567987208227. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -40.39796895081545 (T) = (0 -4.535922444509878) / Math.Sqrt((0.02400288667205099 / (22)) + (0.008595310543361823 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.5055817968943038 = (3.012737304520103 - 4.535922444509878) / 3.012737304520103 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MultiplyByQuaternionBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark.html>)	13.87 ns	18.50 ns	1.33	0.01	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.496433211132878 > 14.661744514090861. IsChangePoint: Marked as a change because one of 6/23/2022 6:26:05 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -107.20407872365591 (T) = (0 -18.524699373251025) / Math.Sqrt((0.008753672804762674 / (22)) + (0.0377183379747763 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3312350667357637 = (13.915423230755373 - 18.524699373251025) / 13.915423230755373 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_GC<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_GC(Byte).AllocateUninitializedArray(length%3a%2010000%2c%20pinned%3a%20True).html>)	378.67 ns	407.90 ns	1.08	0.01	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC&lt;Byte&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_GC<Byte>.AllocateUninitializedArray(length: 10000, pinned: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 407.8995246017407 > 394.9717334722229. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -28.123227604177096 (T) = (0 -410.976992271232) / Math.Sqrt((18.921457715102882 / (22)) + (8.60876366070901 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08071337705134522 = (380.283062094184 - 410.976992271232) / 380.283062094184 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.CtorDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).HashSet.html>)	4.41 ns	5.71 ns	1.29	0.23	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).Stack.html>)	4.63 ns	6.51 ns	1.40	0.18	False
[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).SortedList.html>)	8.82 ns	11.06 ns	1.25	0.17	False
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).LinkedList.html>)	3.85 ns	5.15 ns	1.34	0.24	False
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).ConcurrentStack.html>)	3.08 ns	4.63 ns	1.50	0.39	False
[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).List.html>)	4.61 ns	6.18 ns	1.34	0.16	False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).SortedDictionary.html>)	15.50 ns	17.05 ns	1.10	0.22	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).Dictionary.html>)	5.07 ns	6.36 ns	1.25	0.14	False
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).Queue.html>)	4.82 ns	6.45 ns	1.34	0.21	False
[SortedSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSize(Int32).SortedSet.html>)	5.13 ns	7.10 ns	1.38	0.16	False

graph graph graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.CtorDefaultSize<Int32>.HashSet ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.705743157765495 > 4.696658939800241. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -30.555481555436042 (T) = (0 -5.747990676002775) / Math.Sqrt((0.038065638455089666 / (22)) + (0.006795730852003772 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.31101856169633496 = (4.384370171361582 - 5.747990676002775) / 4.384370171361582 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Stack ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.506320366341803 > 4.686071213850108. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.33222916834116 (T) = (0 -6.446039668036729) / Math.Sqrt((0.07005030486249603 / (22)) + (0.01807225792193666 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.39550770714599576 = (4.619135842122837 - 6.446039668036729) / 4.619135842122837 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.SortedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.060912613206543 > 9.320331005167072. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.83208591794399 (T) = (0 -10.765192430226667) / Math.Sqrt((0.17005634022022423 / (22)) + (0.04840296835663442 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.206745044372883 = (8.920850746746662 - 10.765192430226667) / 8.920850746746662 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.LinkedList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.146295333929038 > 3.977894652041443. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -34.38076002118589 (T) = (0 -4.998259447202735) / Math.Sqrt((0.03287336719118907 / (22)) + (0.005773510843570462 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.398535529570081 = (3.5739238235436415 - 4.998259447202735) / 3.5739238235436415 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.ConcurrentStack ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.630637531655479 > 3.3398649449280904. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -36.45513557826463 (T) = (0 -4.501012824905134) / Math.Sqrt((0.02660707202488273 / (22)) + (0.007696175428847196 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.45826029622302283 = (3.086563377308573 - 4.501012824905134) / 3.086563377308573 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.List ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.182839978605717 > 4.796618684502285. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -51.43432558510307 (T) = (0 -6.3395038742970025) / Math.Sqrt((0.01221708256217827 / (22)) + (0.018365680131979784 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.40486394986811497 = (4.512539363610362 - 6.3395038742970025) / 4.512539363610362 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.SortedDictionary ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.046542778286312 > 16.438918499947814. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.48936279141659 (T) = (0 -17.639151015173265) / Math.Sqrt((0.18476338630370864 / (22)) + (0.052796324336607726 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14209121439313574 = (15.444607919995292 - 17.639151015173265) / 15.444607919995292 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Dictionary ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.361780156448092 > 5.250931297573066. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -38.90558155872575 (T) = (0 -6.276032923366575) / Math.Sqrt((0.020324781735522882 / (22)) + (0.00942787752615042 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2859157659348396 = (4.880594117923426 - 6.276032923366575) / 4.880594117923426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.Queue ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.451950125594989 > 5.03915516722251. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -52.95410383937989 (T) = (0 -6.5730339235382) / Math.Sqrt((0.01148281213411618 / (22)) + (0.015505772391694378 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3687607628199698 = (4.802178804421747 - 6.5730339235382) / 4.802178804421747 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSize<Int32>.SortedSet ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.095325940455303 > 5.359548049272188. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -49.44679257867163 (T) = (0 -6.888700866591643) / Math.Sqrt((0.0065562838314511245 / (22)) + (0.027432673367364897 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3587678658305567 = (5.069814380972923 - 6.888700866591643) / 5.069814380972923 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BenchStringSort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/ByteMark.BenchStringSort.html>)	1.03 secs	1.14 secs	1.11	0.00	False
[BenchBitOps - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/ByteMark.BenchBitOps.html>)	679.50 ms	723.42 ms	1.06	0.03	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'ByteMark*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### ByteMark.BenchStringSort ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.143833937642857 > 1.0802608208033655. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -40.60711286627318 (T) = (0 -1140440058.4520214) / Math.Sqrt((108558310523524.03 / (22)) + (85645803257687.84 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11375796422665127 = (1023956815.6479106 - 1140440058.4520214) / 1023956815.6479106 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### ByteMark.BenchBitOps ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 723.4187814285715 > 719.330815415. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.202742074832933 (T) = (0 -733191743.8634881) / Math.Sqrt((77450606508228.69 / (22)) + (183672211381584.53 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0723399373324647 = (683730707.3420802 - 733191743.8634881) / 683730707.3420802 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Ctor_Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address%3a%20%5b16%2c%2032%2c%2048%2c%2064%2c%2080%2c%20...%5d).html>)	15.67 ns	17.52 ns	1.12	0.09	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [16, 32, 48, 64, 80, ...]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.515414835111212 > 16.516023189800865. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -30.762315605020746 (T) = (0 -17.49647530238553) / Math.Sqrt((0.030464000076362536 / (22)) + (0.043920415751387845 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.10800952239424531 = (15.790906981176683 - 17.49647530238553) / 15.790906981176683 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Reflection.Activator<EmptyClass>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[CreateInstanceType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Reflection.Activator(EmptyClass).CreateInstanceType.html>)	8.72 ns	10.46 ns	1.20	0.32	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Activator&lt;EmptyClass&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Reflection.Activator<EmptyClass>.CreateInstanceType ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.464660343012484 > 9.32298892083248. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -12.565729853771444 (T) = (0 -10.215592259256976) / Math.Sqrt((0.1556184062412344 / (22)) + (0.07806974827359282 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14086674597501386 = (8.954237903153597 - 10.215592259256976) / 8.954237903153597 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Enumerator - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList.Enumerator.html>)	129.11 ns	150.66 ns	1.17	0.02	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList.Enumerator ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 150.65580587539586 > 134.6730834988778. IsChangePoint: Marked as a change because one of 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -44.50091112056521 (T) = (0 -149.29495322619093) / Math.Sqrt((1.2692360770780493 / (22)) + (4.4762450012881825 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16673364669690174 = (127.9597564095752 - 149.29495322619093) / 127.9597564095752 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Net.Tests.Perf_WebUtility

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Decode_NoDecodingRequired - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired.html>)	51.23 ns	61.00 ns	1.19	0.03	False
[Decode_DecodingRequired - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired.html>)	85.02 ns	92.67 ns	1.09	0.02	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Tests.Perf_WebUtility*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.003215433192686 > 53.263256138392194. IsChangePoint: Marked as a change because one of 6/20/2022 2:50:37 PM, 6/23/2022 8:35:19 AM, 7/2/2022 7:35:06 PM, 7/13/2022 7:22:00 AM, 8/4/2022 6:25:19 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -10.355819471428415 (T) = (0 -60.41059810770777) / Math.Sqrt((8.65250999703758 / (22)) + (0.22120119414683256 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12190904276280623 = (53.84625295375194 - 60.41059810770777) / 53.84625295375194 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 92.66678561491192 > 89.6443858955649. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -35.28317088848026 (T) = (0 -91.96636523774319) / Math.Sqrt((0.4633772963828418 / (22)) + (0.5383652925255537 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08507993698647122 = (84.75538262476401 - 91.96636523774319) / 84.75538262476401 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOfValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Memory.Span(Int32).IndexOfValue(Size%3a%20512).html>)	17.92 ns	20.78 ns	1.16	0.24	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Memory.Span<Int32>.IndexOfValue(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.778972359587314 > 19.474178915046128. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 8:41:56 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -10.429668536069007 (T) = (0 -20.886607008734902) / Math.Sqrt((1.0026896626261563 / (22)) + (0.1652969815077592 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12840938710227603 = (18.509777787626465 - 20.886607008734902) / 18.509777787626465 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Xml.Linq.Perf_XElementList

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Enumerator - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Xml.Linq.Perf_XElementList.Enumerator.html>)	176.65 ns	197.61 ns	1.12	0.00	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Linq.Perf_XElementList*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Xml.Linq.Perf_XElementList.Enumerator ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 197.61186388917213 > 186.14048768551947. IsChangePoint: Marked as a change because one of 6/14/2022 6:55:13 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -143.46678408213586 (T) = (0 -197.3415559500036) / Math.Sqrt((0.32635996238694065 / (22)) + (0.13710943002386686 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11493922622294374 = (176.99758992114167 - 197.3415559500036) / 176.99758992114167 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Byte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Byte.ToString(value%3a%20255).html>)	7.66 ns	8.99 ns	1.17	0.10	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Byte*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Byte.ToString(value: 255) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.989179525402808 > 8.030752620973747. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 7/26/2022 9:42:12 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -14.580839685912354 (T) = (0 -9.046611059493546) / Math.Sqrt((0.08803312710922143 / (22)) + (0.033280936739152035 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13267264547993401 = (7.986959953164873 - 9.046611059493546) / 7.986959953164873 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in Benchstone.MDBenchI.MDNDhrystone

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/Benchstone.MDBenchI.MDNDhrystone.Test.html>)	275.70 ms	300.24 ms	1.09	0.10	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDNDhrystone*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### Benchstone.MDBenchI.MDNDhrystone.Test ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 300.23925064285714 > 292.64760223499997. IsChangePoint: Marked as a change because one of 6/20/2022 2:50:37 PM, 6/20/2022 11:14:52 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.539601196169876 (T) = (0 -304621197.1313399) / Math.Sqrt((23576284677760.6 / (22)) + (28061848667639.176 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09223388821925495 = (278897405.04937553 - 304621197.1313399) / 278897405.04937553 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_SByte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_SByte.ToString(value%3a%20127).html>)	8.26 ns	9.60 ns	1.16	0.09	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_SByte*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_SByte.ToString(value: 127) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.600957345744765 > 8.55617986877208. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -33.1334772970375 (T) = (0 -9.665604885273027) / Math.Sqrt((0.03196749969197107 / (22)) + (0.0031750937874353256 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.15747670517041956 = (8.350582644209608 - 9.665604885273027) / 8.350582644209608 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.IterateForEach<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConcurrentBag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.IterateForEach(Int32).ConcurrentBag(Size%3a%20512).html>)	1.48 μs	1.70 μs	1.15	0.01	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.6995934682237916 > 1.5533625928081605. IsChangePoint: Marked as a change because one of 7/28/2022 6:38:38 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -332.0404405129318 (T) = (0 -1696.9519024750325) / Math.Sqrt((5.574359347145495 / (22)) + (4.816740916889725 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.14888531536035815 = (1477.0420335146928 - 1696.9519024750325) / 1477.0420335146928 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.ContainsTrueComparer<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsTrueComparer(String).HashSet(Size%3a%20512).html>)	20.17 μs	21.36 μs	1.06	0.15	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrueComparer&lt;String&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.ContainsTrueComparer<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.363771142824394 > 20.87959957742648. IsChangePoint: Marked as a change because one of 7/6/2022 12:32:56 PM, 7/27/2022 9:27:06 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -9.487764847902133 (T) = (0 -21914.850647580803) / Math.Sqrt((264390.14597900753 / (22)) + (774705.940907251 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09712792908825264 = (19974.745028861606 - 21914.850647580803) / 19974.745028861606 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SubString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubString.html>)	7.02 ns	8.24 ns	1.18	0.15	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubString ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.24442311124477 > 7.362901033259298. IsChangePoint: Marked as a change because one of 6/27/2022 11:36:16 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.667542326363822 (T) = (0 -8.263590284768009) / Math.Sqrt((0.08264115001158936 / (22)) + (0.03297306285945262 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.17862111105279685 = (7.011235593248964 - 8.263590284768009) / 7.011235593248964 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Array

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ArrayResize - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Array.ArrayResize.html>)	73.07 ns	100.92 ns	1.38	0.14	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Array*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Array.ArrayResize ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 100.92306227499999 > 76.207573299375. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.421709637441726 (T) = (0 -90.99716695020243) / Math.Sqrt((3.26296620810621 / (22)) + (26.063774990496395 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2584623613798204 = (72.30821496356083 - 90.99716695020243) / 72.30821496356083 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[GetNames - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Enum.GetNames.html>)	19.31 ns	21.64 ns	1.12	0.12	False
[GetName - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Enum.GetName.html>)	14.32 ns	17.50 ns	1.22	0.38	False
[EnumToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Enum.EnumToString(value%3a%20Yellow).html>)	18.32 ns	22.07 ns	1.20	0.31	False

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Enum*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Enum.GetNames ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.639227504181505 > 20.258352734689506. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.13750703872876 (T) = (0 -21.780642474435815) / Math.Sqrt((0.28309504196429414 / (22)) + (0.13311211044017057 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1257265724418792 = (19.348075285448893 - 21.780642474435815) / 19.348075285448893 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Enum.GetName ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.497851152396834 > 15.514120622130124. IsChangePoint: Marked as a change because one of 7/31/2022 3:07:22 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -12.51443903794301 (T) = (0 -16.632790468673317) / Math.Sqrt((0.43027415897484744 / (22)) + (0.4416544499392883 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1679962011128121 = (14.240449115182372 - 16.632790468673317) / 14.240449115182372 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Enum.EnumToString(value: Yellow) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.068344797048272 > 20.455598119150284. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/1/2022 4:16:36 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -12.070209409600958 (T) = (0 -22.604515257065973) / Math.Sqrt((0.7401687739534683 / (22)) + (1.6636961755388249 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.20025867081075238 = (18.83303641688924 - 22.604515257065973) / 18.83303641688924 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse_ParallelAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark.Parse_ParallelAsync(Length%3a%204096%2c%20Chunks%3a%2016).html>)	827.58 ns	870.79 ns	1.05	0.37	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark.Parse_ParallelAsync(Length: 4096, Chunks: 16) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 870.7919891640867 > 856.9342627322114. IsChangePoint: Marked as a change because one of 7/17/2022 5:11:11 AM, 7/31/2022 3:07:22 PM, 8/1/2022 8:26:50 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -8.60830530483418 (T) = (0 -916.7771316251304) / Math.Sqrt((1049.7410874703357 / (22)) + (1930.5426404864452 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11569684675762887 = (821.7080959665818 - 916.7771316251304) / 821.7080959665818 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).ImmutableDictionary(Size%3a%20512).html>)	15.56 μs	17.01 μs	1.09	0.04	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.ContainsKeyFalse<Int32, Int32>.ImmutableDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.013078529651796 > 16.387963750467815. IsChangePoint: Marked as a change because one of 6/20/2022 2:50:37 PM, 7/5/2022 7:01:28 PM, 7/7/2022 8:07:51 AM, 7/10/2022 1:04:01 AM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -30.399506246272033 (T) = (0 -16968.098623430116) / Math.Sqrt((11052.890359907347 / (22)) + (39508.156809372675 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08761831960042121 = (15601.151909305836 - 16968.098623430116) / 15601.151909305836 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Transient - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Transient.html>)	79.77 ns	85.25 ns	1.07	0.18	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Transient ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.2517605337722 > 82.85358271037515. IsChangePoint: Marked as a change because one of 7/4/2022 6:59:29 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -10.171737128297414 (T) = (0 -83.80438170827755) / Math.Sqrt((3.694226354559978 / (22)) + (4.878667523889832 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07802116013838954 = (77.73908788350617 - 83.80438170827755) / 77.73908788350617 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Int32.ToString(value%3a%2012345).html>)	10.18 ns	11.65 ns	1.14	0.05	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Int32.ToString(value%3a%202147483647).html>)	14.62 ns	16.37 ns	1.12	0.04	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Int32.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.648713403549152 > 10.543783074645285. IsChangePoint: Marked as a change because one of 7/2/2022 3:52:19 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.13350081647449 (T) = (0 -11.683782090300525) / Math.Sqrt((0.09494327044084898 / (22)) + (0.003725025233719358 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1997642195815383 = (9.73839851164729 - 11.683782090300525) / 9.73839851164729 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Int32.ToString(value: 2147483647) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.36992965051305 > 15.125852096838612. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.291601454718297 (T) = (0 -16.333079339355812) / Math.Sqrt((0.13911970991660955 / (22)) + (0.036368493047313814 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13628103481421663 = (14.374154666786541 - 16.333079339355812) / 14.374154666786541 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Memory.Span<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOfAnyTwoValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Memory.Span(Char).IndexOfAnyTwoValues(Size%3a%20512).html>)	10.67 ns	12.81 ns	1.20	0.04	False
[IndexOfAnyThreeValues - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Memory.Span(Char).IndexOfAnyThreeValues(Size%3a%20512).html>)	12.24 ns	15.57 ns	1.27	0.13	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Char&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Memory.Span<Char>.IndexOfAnyTwoValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.813648313485176 > 10.903800743957666. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.934928395920714 (T) = (0 -12.989400492876571) / Math.Sqrt((0.20267294680499123 / (22)) + (0.04235175339057955 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.24980588868121814 = (10.393134334310785 - 12.989400492876571) / 10.393134334310785 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.569891572223744 > 13.145743768589721. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.391433466027188 (T) = (0 -15.552742386565258) / Math.Sqrt((0.2733989501992666 / (22)) + (0.06574646927204174 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.23730974251908807 = (12.569805160428796 - 15.552742386565258) / 12.569805160428796 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22Huck%5ba-zA-Z%5d%2b%7cSaw%5ba-zA-Z%5d%2b%22%2c%20Options%3a%20Compiled).html>)	1.85 ms	1.97 ms	1.06	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22Twain%22%2c%20Options%3a%20NonBacktracking).html>)	1.64 ms	2.10 ms	1.28	0.49	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22Huck%5ba-zA-Z%5d%2b%7cSaw%5ba-zA-Z%5d%2b%22%2c%20Options%3a%20NonBacktracking).html>)	2.12 ms	2.29 ms	1.08	0.01	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20NonBacktracking).html>)	1.82 ms	2.11 ms	1.16	0.14	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20None).html>)	1.83 ms	2.26 ms	1.24	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20Compiled).html>)	1.72 ms	2.03 ms	1.18	0.08	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22Twain%22%2c%20Options%3a%20Compiled).html>)	1.69 ms	1.89 ms	1.11	0.47	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22Twain%22%2c%20Options%3a%20None).html>)	1.59 ms	1.90 ms	1.20	0.54	False

graph graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "Huck[a-zA-Z]+|Saw[a-zA-Z]+", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.9716907072916667 > 1.942322128385417. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -48.730000816303594 (T) = (0 -1977404.9029124624) / Math.Sqrt((60054611.007439785 / (22)) + (102753464.87687501 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.06803516965692685 = (1851441.7493832551 - 1977404.9029124624) / 1851441.7493832551 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "Twain", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.104468517086835 > 1.7754491249342108. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.09401384315179 (T) = (0 -2044359.6655629375) / Math.Sqrt((3980581604.4481893 / (22)) + (7308664879.790178 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.21911387532793447 = (1676922.6459776096 - 2044359.6655629375) / 1676922.6459776096 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "Huck[a-zA-Z]+|Saw[a-zA-Z]+", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.2895606607142858 > 2.230493521367521. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -65.91829071928315 (T) = (0 -2286574.6067101797) / Math.Sqrt((70583742.93016294 / (22)) + (85684963.05418266 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0793546878330929 = (2118464.5163312308 - 2286574.6067101797) / 2118464.5163312308 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.111597826210826 > 1.9508193568502052. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.369669913200013 (T) = (0 -2225836.6085451446) / Math.Sqrt((1576332422.7513134 / (22)) + (12696522246.996706 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.195317149874734 = (1862130.5724413025 - 2225836.6085451446) / 1862130.5724413025 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.264293988520408 > 1.9222731184895834. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.727129988861874 (T) = (0 -2182206.313021116) / Math.Sqrt((2177274905.5956845 / (22)) + (11218552361.53181 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.19902303794868798 = (1819986.9760254791 - 2182206.313021116) / 1819986.9760254791 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.0279654145833335 > 1.8464831518559028. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.759432690009437 (T) = (0 -2142512.687208345) / Math.Sqrt((1741621042.539697 / (22)) + (9257793453.095762 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.22348988697859792 = (1751148.6690742245 - 2142512.687208345) / 1751148.6690742245 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "Twain", Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.8862294875992065 > 1.711454690640625. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -15.187788376580354 (T) = (0 -1938004.1967446816) / Math.Sqrt((3629654285.6225834 / (22)) + (7370499885.776192 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.19898364651306208 = (1616372.5021445223 - 1938004.1967446816) / 1616372.5021445223 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "Twain", Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.903974058226496 > 1.6645384782812502. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -2.1032853150283763 (T) = (0 -2725309.791592751) / Math.Sqrt((3801427250.1404 / (22)) + (6914788913402.704 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.6614914872857297 = (1640279.1181584157 - 2725309.791592751) / 1640279.1181584157 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_GC<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AllocateUninitializedArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_GC(Char).AllocateUninitializedArray(length%3a%2010000%2c%20pinned%3a%20True).html>)	657.05 ns	724.46 ns	1.10	0.02	False
[AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_GC(Char).AllocateArray(length%3a%2010000%2c%20pinned%3a%20True).html>)	1.01 μs	1.07 μs	1.06	0.01	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC&lt;Char&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_GC<Char>.AllocateUninitializedArray(length: 10000, pinned: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 724.4613475838044 > 688.8122636801864. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -31.96332699805453 (T) = (0 -722.3135273612098) / Math.Sqrt((37.321543068693394 / (22)) + (63.40933600197663 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09888479297920554 = (657.3150633952565 - 722.3135273612098) / 657.3150633952565 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_GC<Char>.AllocateArray(length: 10000, pinned: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0705066747478713 > 1.0517202456293415. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.02898938948592 (T) = (0 -1068.236595292935) / Math.Sqrt((114.74611005538675 / (22)) + (136.75853506394552 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0577817975268987 = (1009.8836998239898 - 1068.236595292935) / 1009.8836998239898 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ToByteArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString%3a%20123).html>)	10.89 ns	13.21 ns	1.21	0.03	False
[Subtract - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_BigInteger.Subtract(arguments%3a%2016%2c16%20bits).html>)	4.35 ns	8.18 ns	1.88	0.05	False
[Add - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_BigInteger.Add(arguments%3a%2016%2c16%20bits).html>)	4.36 ns	7.95 ns	1.83	0.08	False
[Multiply - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_BigInteger.Multiply(arguments%3a%2016%2c16%20bits).html>)	4.09 ns	7.75 ns	1.90	0.02	False

graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.206495641458813 > 11.457834184903355. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -33.57699487142209 (T) = (0 -12.96446352917227) / Math.Sqrt((0.04192369930362966 / (22)) + (0.06298407461919078 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.20538062817504332 = (10.755493514775146 - 12.96446352917227) / 10.755493514775146 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.182169725649475 > 4.569822316020291. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 9/7/2022 8:07:21 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -85.88829313777677 (T) = (0 -8.035155259837916) / Math.Sqrt((0.031011349478788353 / (23)) + (0.010771945371616758 / (25))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (25) - 2, .025) and -0.8210638622937699 = (4.412341283691732 - 8.035155259837916) / 4.412341283691732 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.951109791624393 > 4.5732167434187225. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 9/7/2022 8:07:21 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -102.14363632488678 (T) = (0 -8.02895540349495) / Math.Sqrt((0.020210951238244054 / (23)) + (0.009723568452775434 / (25))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (25) - 2, .025) and -0.8280101066721521 = (4.392183267581308 - 8.02895540349495) / 4.392183267581308 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 16,16 bits) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.754975374019345 > 4.295394576544658. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 9/7/2022 8:07:21 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -166.65050822176673 (T) = (0 -7.75442571866858) / Math.Sqrt((0.01092675470632548 / (23)) + (2.9626970330356518E-06 / (25))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (25) - 2, .025) and -0.8814035714730775 = (4.121617411726883 - 7.75442571866858) / 4.121617411726883 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.IO.Tests.StringReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	2.59 μs	2.88 μs	1.11	0.03	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	2.83 μs	3.08 μs	1.09	0.01	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b1025%2c%202048%5d).html>)	2.74 μs	2.91 μs	1.06	0.02	False
[ReadLine - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	2.69 μs	2.91 μs	1.08	0.02	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20%20%200%2c%201024%5d).html>)	3.03 μs	3.20 μs	1.06	0.02	False
[ReadLineAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>)	2.94 μs	3.25 μs	1.11	0.01	False

graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadLineTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.8807643478062985 > 2.7492058243772552. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.146858658240582 (T) = (0 -2866.190010845401) / Math.Sqrt((743.5141291919166 / (22)) + (741.7933048395101 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08729096700502667 = (2636.0837143165104 - 2866.190010845401) / 2636.0837143165104 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.079610672778013 > 2.9241794840767534. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -33.3030276241759 (T) = (0 -3065.6394184345118) / Math.Sqrt((941.962050731608 / (22)) + (562.9385096814453 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09555868911266156 = (2798.242986797449 - 3065.6394184345118) / 2798.242986797449 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.9143968310731316 > 2.80248138854059. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.793690058032485 (T) = (0 -2923.9161220971555) / Math.Sqrt((1623.794341482699 / (22)) + (1096.3301382138943 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0916462163979039 = (2678.446623252337 - 2923.9161220971555) / 2678.446623252337 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.9110854012202667 > 2.826460994237682. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -17.873691727416983 (T) = (0 -2897.311560731888) / Math.Sqrt((1305.5086522253828 / (22)) + (1708.9350352926015 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07410392308109955 = (2697.4220077521572 - 2897.311560731888) / 2697.4220077521572 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.2004205368737617 > 3.1716146681057245. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.54223733300422 (T) = (0 -3250.9297426259695) / Math.Sqrt((1321.3752585732022 / (22)) + (1638.0640093057957 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.08333333704540634 = (3000.858213679906 - 3250.9297426259695) / 3000.858213679906 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.StringReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 129, 1024]) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.249341954480197 > 3.0794703433714234. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.56341489060923 (T) = (0 -3219.860416506333) / Math.Sqrt((1763.352897815251 / (22)) + (1281.1016667548754 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09503646701927439 = (2940.4138706639606 - 3219.860416506333) / 2940.4138706639606 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Threading.Tests.Perf_CancellationToken

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[CreateLinkedTokenSource2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2.html>)	61.98 ns	68.64 ns	1.11	0.03	False
[CreateLinkedTokenSource1 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1.html>)	35.48 ns	38.56 ns	1.09	0.12	False
[CreateLinkedTokenSource3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3.html>)	95.04 ns	105.87 ns	1.11	0.02	False

graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.64030205513693 > 64.92047380137362. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -27.8735792206063 (T) = (0 -68.77816816862108) / Math.Sqrt((0.446226404357974 / (22)) + (1.1010951488143295 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11287262301707307 = (61.80237229860036 - 68.77816816862108) / 61.80237229860036 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource1 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.563476301433695 > 37.1364118633438. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -16.19377126582158 (T) = (0 -38.74512518861995) / Math.Sqrt((0.6801778468074305 / (22)) + (0.21661066124085374 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.0902773147600578 = (35.536945201090205 - 38.74512518861995) / 35.536945201090205 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 105.87288206906086 > 99.9467535007466. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -41.83920453717935 (T) = (0 -106.7953467141472) / Math.Sqrt((0.6107472152490434 / (22)) + (1.1207744574434324 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.11643676904879657 = (95.65731770473376 - 106.7953467141472) / 95.65731770473376 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Int64.ToString(value%3a%2012345).html>)	10.81 ns	12.55 ns	1.16	0.10	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Int64.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.553240165716982 > 11.24251498691901. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -37.20397315169258 (T) = (0 -12.48011099292352) / Math.Sqrt((0.050363196810995214 / (22)) + (0.01166315395912017 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.18480823036005822 = (10.533443871444804 - 12.48011099292352) / 10.533443871444804 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.IO.Tests.BinaryWriterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DefaultCtor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.IO.Tests.BinaryWriterTests.DefaultCtor.html>)	7.29 ns	9.50 ns	1.30	0.21	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.IO.Tests.BinaryWriterTests.DefaultCtor ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.500373206107499 > 7.759208814653151. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -23.69676217803073 (T) = (0 -9.720212977080626) / Math.Sqrt((0.17744512568562032 / (22)) + (0.0379970541622902 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.31225756191360693 = (7.407244781204439 - 9.720212977080626) / 7.407244781204439 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IndexOf_Word_NotFound - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>)	19.29 ns	24.09 ns	1.25	0.14	False
[IsSuffix_DifferentLastChar - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options%3a%20(%2c%20None%2c%20True)).html>)	635.03 ns	733.92 ns	1.16	0.05	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, Ordinal, False)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.09192372450629 > 20.602425209816683. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.264281233637096 (T) = (0 -25.194494712497082) / Math.Sqrt((0.6335409161429014 / (22)) + (0.9055182145952575 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2704732077320264 = (19.83079576898186 - 25.194494712497082) / 19.83079576898186 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, None, True)) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 733.9186307083274 > 672.9295361750146. IsChangePoint: Marked as a change because one of 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -28.14367145584199 (T) = (0 -722.9795684548749) / Math.Sqrt((101.32931872069469 / (22)) + (79.0602649979081 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12062921103278171 = (645.1550266020378 - 722.9795684548749) / 645.1550266020378 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in Microsoft.Extensions.DependencyInjection.GetService

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[NoDI - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/Microsoft.Extensions.DependencyInjection.GetService.NoDI.html>)	3.09 ns	4.60 ns	1.49	0.38	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.GetService*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### Microsoft.Extensions.DependencyInjection.GetService.NoDI ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.602799639988371 > 3.3385605950056374. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -37.38303971056929 (T) = (0 -4.526177075468595) / Math.Sqrt((0.02621659285871857 / (22)) + (0.008059522992702454 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4707105168015037 = (3.077544509107142 - 4.526177075468595) / 3.077544509107142 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20NonBacktracking).html>)	509.70 ms	649.46 ms	1.27	0.06	False
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options%3a%20None).html>)	485.57 ms	623.68 ms	1.28	0.05	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: NonBacktracking) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 649.456833 > 521.63021925. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.892320210106263 (T) = (0 -687234866.8621795) / Math.Sqrt((69484648908096.484 / (22)) + (1829004165179248.8 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.3757318064251551 = (499541308.59848493 - 687234866.8621795) / 499541308.59848493 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: None) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 623.68117725 > 507.29962670625. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.742653415094907 (T) = (0 -666935973.4679487) / Math.Sqrt((79772346377933.25 / (22)) + (1953116067662149.5 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.4070553397215995 = (473994131.31818175 - 666935973.4679487) / 473994131.31818175 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.ContainsFalse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsFalse(String).Stack(Size%3a%20512).html>)	655.18 μs	705.95 μs	1.08	0.04	False
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsFalse(String).Span(Size%3a%20512).html>)	618.50 μs	681.45 μs	1.10	0.02	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse&lt;String&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.ContainsFalse<String>.Stack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 705.9506454849499 > 689.2125907639723. IsChangePoint: Marked as a change because one of 6/21/2022 5:13:43 PM, 7/7/2022 6:46:26 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -194.19479673355036 (T) = (0 -706739.1597206687) / Math.Sqrt((660839.6188950157 / (22)) + (929969.2448098788 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.07583271918502182 = (656922.9092196104 - 706739.1597206687) / 656922.9092196104 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsFalse<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 681.445570652174 > 649.2166563852164. IsChangePoint: Marked as a change because one of 7/10/2022 1:04:01 AM, 7/13/2022 7:22:00 AM, 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -435.10853852361265 (T) = (0 -681252.2709289092) / Math.Sqrt((363713.0967424502 / (22)) + (110937.28896629023 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.10145669803274696 = (618501.1831565031 - 681252.2709289092) / 618501.1831565031 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_UInt32.ToString(value%3a%2012345).html>)	9.97 ns	11.11 ns	1.11	0.08	False
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_UInt32.Parse(value%3a%20%224294967295%22).html>)	14.09 ns	19.20 ns	1.36	0.26	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_UInt32.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.11468620380508 > 10.243865622493574. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -18.654687828517858 (T) = (0 -11.15517697795603) / Math.Sqrt((0.22232474391077559 / (22)) + (0.0023631586976923438 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.20317326111480613 = (9.271463502787741 - 11.15517697795603) / 9.271463502787741 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt32.Parse(value: "4294967295") ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.197280512050472 > 14.758995664789847. IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 7/2/2022 7:35:06 PM, 7/6/2022 8:41:56 AM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -9.736103532224716 (T) = (0 -18.80085815353331) / Math.Sqrt((1.9877092208090583 / (22)) + (0.13294506228565087 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.19047965659395533 = (15.792674867980411 - 18.80085815353331) / 15.792674867980411 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.ContainsTrue<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsTrue(String).Span(Size%3a%20512).html>)	312.14 μs	343.17 μs	1.10	0.02	False
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.ContainsTrue(String).HashSet(Size%3a%20512).html>)	8.10 μs	9.16 μs	1.13	0.01	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.ContainsTrue<String>.Span(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 343.169346564441 > 327.7384371835114. IsChangePoint: Marked as a change because one of 7/10/2022 1:04:01 AM, 7/13/2022 7:22:00 AM, 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -515.8462884921585 (T) = (0 -343381.68478913617) / Math.Sqrt((39801.090943150564 / (22)) + (49075.62515893297 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1005183859643766 = (312018.1263380104 - 343381.68478913617) / 312018.1263380104 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsTrue<String>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.164037111519608 > 8.487762064972658. IsChangePoint: Marked as a change because one of 7/6/2022 12:32:56 PM, 7/27/2022 9:27:06 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -53.191405041161275 (T) = (0 -9187.655840704714) / Math.Sqrt((3126.784205940896 / (22)) + (8486.509228563002 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1432697520667999 = (8036.297491554636 - 9187.655840704714) / 8036.297491554636 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.CtorDefaultSizeNonGeneric

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ArrayList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSizeNonGeneric.ArrayList.html>)	4.61 ns	6.44 ns	1.40	0.16	False
[Stack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorDefaultSizeNonGeneric.Stack.html>)	11.04 ns	12.67 ns	1.15	0.13	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSizeNonGeneric*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.CtorDefaultSizeNonGeneric.ArrayList ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 6.435093953815114 > 4.754531181061827. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -28.94654933159464 (T) = (0 -6.390490292642179) / Math.Sqrt((0.0729939677673652 / (22)) + (0.01486296921055339 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.39372117466844003 = (4.585199973131245 - 6.390490292642179) / 4.585199973131245 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.CtorDefaultSizeNonGeneric.Stack ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.6670206325789 > 11.764029463570434. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.258329426485528 (T) = (0 -12.577637157745663) / Math.Sqrt((0.02208349296436315 / (22)) + (0.07109726872392703 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.12132879101104066 = (11.216725423062666 - 12.577637157745663) / 11.216725423062666 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<XmlElement>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[DataContractSerializer_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/MicroBenchmarks.Serializers.XmlFromStream(XmlElement).DataContractSerializer.html>)	1.74 μs	2.08 μs	1.19	0.03	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;XmlElement&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### MicroBenchmarks.Serializers.Xml_FromStream<XmlElement>.DataContractSerializer_ ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.075317229832572 > 1.8107404262287263. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -32.12468149889044 (T) = (0 -2073.594795750738) / Math.Sqrt((1056.3320806182983 / (22)) + (1538.8616404019838 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.19104973550420043 = (1740.9808624598993 - 2073.594795750738) / 1740.9808624598993 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.Tests.Add_Remove_SteadyState<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ImmutableStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.Tests.Add_Remove_SteadyState(Int32).ImmutableStack(Count%3a%20512).html>)	8.48 ns	9.68 ns	1.14	0.17	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState&lt;Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.Tests.Add_Remove_SteadyState<Int32>.ImmutableStack(Count: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.684702612133712 > 8.940568715267556. IsChangePoint: Marked as a change because one of 7/21/2022 2:43:00 AM, 7/21/2022 11:11:59 AM, 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -9.534205349033604 (T) = (0 -9.795501148004654) / Math.Sqrt((0.31591756032049045 / (22)) + (0.012582247687391303 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.13453968202014419 = (8.633899107489068 - 9.795501148004654) / 8.633899107489068 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Version

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Ctor4 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Version.Ctor4.html>)	4.80 ns	5.82 ns	1.21	0.15	False
[Ctor3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Version.Ctor3.html>)	4.84 ns	5.84 ns	1.21	0.17	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Version*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Version.Ctor4 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.815135316171734 > 5.042637464175158. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -22.780285797479195 (T) = (0 -5.9208787524546835) / Math.Sqrt((0.035497069094585845 / (22)) + (0.019457635124889093 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.22998606913998426 = (4.813777083340958 - 5.9208787524546835) / 4.813777083340958 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_Version.Ctor3 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.844728385630607 > 5.088346408504695. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -24.54059242862638 (T) = (0 -5.922069055997786) / Math.Sqrt((0.03315057121092192 / (22)) + (0.014112932796614557 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.23093284760358246 = (4.811041534497232 - 5.922069055997786) / 4.811041534497232 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Xml.Linq.Perf_XDocument

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Create - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Xml.Linq.Perf_XDocument.Create.html>)	4.23 ns	5.57 ns	1.32	0.21	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Xml.Linq.Perf_XDocument*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Xml.Linq.Perf_XDocument.Create ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.568502356816992 > 4.473122842261754. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -20.047202063331916 (T) = (0 -5.530610276565877) / Math.Sqrt((0.09469166157800417 / (22)) + (0.011207886874275725 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.33232380468321493 = (4.151100698738085 - 5.530610276565877) / 4.151100698738085 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GenericClassWithSTringGenericInstanceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod.html>)	108.73 μs	216.24 μs	1.99	0.01	False
[StructWithInterfaceInterfaceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod.html>)	108.74 μs	130.45 μs	1.20	0.03	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 216.2423362442922 > 114.15775634331598. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -1292.6262173067037 (T) = (0 -216209.5090684853) / Math.Sqrt((1325.876970600987 / (22)) + (178175.0698898292 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.9884331115676457 = (108733.60929804147 - 216209.5090684853) / 108733.60929804147 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.45179999999996 > 114.15529626953125. IsChangePoint: Marked as a change because one of 6/13/2022 2:27:15 PM, 6/21/2022 5:13:43 PM, 7/7/2022 8:07:51 AM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -1961.4339604615 (T) = (0 -130467.4307386654) / Math.Sqrt((1226.0067437205705 / (22)) + (1746.6808440794782 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.2000067535400773 = (108722.24706551046 - 130467.4307386654) / 108722.24706551046 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_Int16.ToString(value%3a%2032767).html>)	9.78 ns	11.57 ns	1.18	0.02	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int16*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_Int16.ToString(value: 32767) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.571387760244827 > 10.243150736806873. IsChangePoint: Marked as a change because one of 6/23/2022 8:35:19 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -36.30884633580015 (T) = (0 -11.649840895238462) / Math.Sqrt((0.038618067452718105 / (22)) + (0.014938577267432352 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.17708005490389095 = (9.897237530024817 - 11.649840895238462) / 9.897237530024817 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.AddGivenSize(Int32).HashSet(Size%3a%20512).html>)	2.82 μs	3.07 μs	1.09	0.02	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>)	3.31 μs	3.63 μs	1.10	0.02	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Collections.AddGivenSize<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.069039907190689 > 2.9501891153194584. IsChangePoint: Marked as a change because one of 6/21/2022 5:13:43 PM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -76.0443118102743 (T) = (0 -3064.1095207301473) / Math.Sqrt((106.41229461001463 / (22)) + (175.55662298373835 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.09228318110743018 = (2805.233636961751 - 3064.1095207301473) / 2805.233636961751 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.6290266289714586 > 3.509643881190288. IsChangePoint: Marked as a change because one of 6/23/2022 8:35:19 AM, 7/5/2022 7:01:28 PM, 9/9/2022 3:12:19 AM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -31.498958149510234 (T) = (0 -3641.191211478418) / Math.Sqrt((4713.464725267449 / (31)) + (215.09463618500493 / (17))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (17) - 2, .025) and -0.12488408964419481 = (3236.9479175673478 - 3641.191211478418) / 3236.9479175673478 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in BenchmarksGame.KNucleotide_9

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[RunBench - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/BenchmarksGame.KNucleotide_9.RunBench.html>)	57.09 ms	60.37 ms	1.06	0.02	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.KNucleotide_9*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### BenchmarksGame.KNucleotide_9.RunBench ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 60.3743696 > 59.9704619390625. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -11.095771460659961 (T) = (0 -59684529.90257253) / Math.Sqrt((534516292733.8597 / (22)) + (1088287114655.4369 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.05021700771849953 = (56830664.009366706 - 59684529.90257253) / 56830664.009366706 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Net.Primitives.Tests.CredentialCacheTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ForEach - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount%3a%2010%2c%20hostPortCount%3a%2010).html>)	263.62 ns	280.73 ns	1.06	0.00	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.CredentialCacheTests*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 10, hostPortCount: 10) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 280.7261295235169 > 277.6492482021973. IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -19.16077899960673 (T) = (0 -284.034784448418) / Math.Sqrt((4.02677486602079 / (22)) + (17.567718894585923 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.06668084381799183 = (266.2790712841216 - 284.034784448418) / 266.2790712841216 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Tests.Perf_UInt16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_UInt16.ToString(value%3a%2065535).html>)	9.10 ns	10.62 ns	1.17	0.08	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Tests.Perf_UInt16.ToString(value%3a%2012345).html>)	9.11 ns	10.55 ns	1.16	0.08	False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt16*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Tests.Perf_UInt16.ToString(value: 65535) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.622600748051727 > 9.563571820957483. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -20.92899640143751 (T) = (0 -10.681407587025374) / Math.Sqrt((0.07058514463995137 / (22)) + (0.013446586168503012 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.1358425051492636 = (9.40395128602949 - 10.681407587025374) / 9.40395128602949 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Tests.Perf_UInt16.ToString(value: 12345) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.546411322415663 > 9.574648467728466. IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -21.836660342001622 (T) = (0 -10.670036419113092) / Math.Sqrt((0.06449440369488937 / (22)) + (0.012715481563761961 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.135968771980369 = (9.392895898460036 - 10.670036419113092) / 9.392895898460036 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Runtime.InteropServices.Tests.Perf_Marshal

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AllocFree - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.InteropServices.Tests.Perf_Marshal.AllocFree.html>)	40.40 ns	54.83 ns	1.36	0.10	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Runtime.InteropServices.Tests.Perf_Marshal*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Runtime.InteropServices.Tests.Perf_Marshal.AllocFree ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.827134217725444 > 42.39848302486363. IsChangePoint: Marked as a change because one of 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -43.74228103867596 (T) = (0 -55.03700188543667) / Math.Sqrt((1.869848306135929 / (22)) + (0.5942930426310251 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.35319900268108967 = (40.671772426961596 - 55.03700188543667) / 40.671772426961596 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	543bcc5ee7d6a2b9471b016770227421c43a756e
Compare	4e1ef1057e1bd248516b2a189a8d20239239480b
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MatchesWord - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options%3a%20Compiled).html>)	839.95 ns	1.00 μs	1.19	0.05	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

### Payloads [Baseline](<>) [Compare](<>) ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: Compiled) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0019345344201727 > 883.017286558634. IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/5/2022 10:47:59 PM, 9/13/2022 2:30:06 AM falls between 8/5/2022 10:47:59 PM and 9/13/2022 2:30:06 AM. IsRegressionStdDev: Marked as regression because -29.35807559037559 (T) = (0 -984.8445301121593) / Math.Sqrt((158.17725365847556 / (22)) + (381.48050803924593 / (26))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (26) - 2, .025) and -0.16195578481130257 = (847.5748758995115 - 984.8445301121593) / 847.5748758995115 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)