[Perf] Alpine/x64: 6 Regressions on 10/2/2022 4:08:45 AM

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	fe335593152fd96bbfd970541a89add763c887a4
Compare	fb5f07f9c580bdcd5d0726d1391c2a52a01030f8
Diff	Diff

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[NewDelegateClassEmptyStaticFn - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.NewDelegateClassEmptyStaticFn.html>)	599.05 μs	659.02 μs	1.10	0.10	False
[GenericGenericMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.GenericGenericMethod.html>)	108.72 μs	152.24 μs	1.40	0.03	False
[StructWithInterfaceInterfaceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod.html>)	108.73 μs	130.50 μs	1.20	0.03	False
[GenericClassGenericInstanceMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.GenericClassGenericInstanceMethod.html>)	108.73 μs	130.44 μs	1.20	0.03	False
[GenericClassGenericStaticMethod - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/PerfLabTests.LowLevelPerf.GenericClassGenericStaticMethod.html>)	108.74 μs	152.20 μs	1.40	0.02	False

graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram ### Edge Detector Info [Collection Data]() #### PerfLabTests.LowLevelPerf.NewDelegateClassEmptyStaticFn ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 659.0219521666668 > 631.4596292217548. IsChangePoint: Marked as a change because one of 10/1/2022 7:19:07 PM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -13.20617643342619 (T) = (0 -658947.431578002) / Math.Sqrt((339577723.15882653 / (54)) + (86409203.78488624 / (13))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (54) + (13) - 2, .025) and -0.07767919534007023 = (611450.4524419867 - 658947.431578002) / 611450.4524419867 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericGenericMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 152.239083954577 > 114.16964701497396. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 8/4/2022 6:25:19 PM, 9/23/2022 1:16:35 AM, 10/2/2022 4:08:26 PM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -113.01722521269713 (T) = (0 -152196.07012748276) / Math.Sqrt((8250620.940914443 / (57)) + (2553.029670119743 / (10))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (57) + (10) - 2, .025) and -0.39424836058764756 = (109159.94196567331 - 152196.07012748276) / 109159.94196567331 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.49845247395834 > 114.15822768554688. IsChangePoint: Marked as a change because one of 7/7/2022 8:07:51 AM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -10.919389045527625 (T) = (0 -130460.20666799883) / Math.Sqrt((87747545.69740567 / (38)) + (1242.7018042176094 / (29))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (38) + (29) - 2, .025) and -0.14572358661506427 = (113867.0864352471 - 130460.20666799883) / 113867.0864352471 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassGenericInstanceMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.43575638020832 > 114.14971964246962. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 7/28/2022 3:42:13 AM, 8/4/2022 6:25:19 PM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -36.9714587897975 (T) = (0 -130472.69097520238) / Math.Sqrt((12469035.399333557 / (38)) + (1633.7684672873604 / (29))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (38) + (29) - 2, .025) and -0.19379290341783736 = (109292.5670789784 - 130472.69097520238) / 109292.5670789784 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### PerfLabTests.LowLevelPerf.GenericClassGenericStaticMethod ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 152.2013857589619 > 114.16749400315506. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 8/4/2022 6:25:19 PM, 9/23/2022 1:16:35 AM, 10/2/2022 4:08:26 PM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -113.15028603458691 (T) = (0 -152202.66081710486) / Math.Sqrt((8248408.382504632 / (57)) + (1264.5330364734054 / (10))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (57) + (10) - 2, .025) and -0.3945535139579418 = (109140.78182997223 - 152202.66081710486) / 109140.78182997223 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	fe335593152fd96bbfd970541a89add763c887a4
Compare	fb5f07f9c580bdcd5d0726d1391c2a52a01030f8
Diff	Diff

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConcurrentStack - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Collections.CtorFromCollection(String).ConcurrentStack(Size%3a%20512).html>)	4.78 μs	5.16 μs	1.08	0.08	False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram ### Edge Detector Info [Collection Data]() #### System.Collections.CtorFromCollection<String>.ConcurrentStack(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.1639468832671955 > 5.015115419301832. IsChangePoint: Marked as a change because one of 7/16/2022 8:22:44 PM, 7/21/2022 3:55:55 PM, 9/13/2022 12:23:36 PM, 10/1/2022 7:19:07 PM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM. IsRegressionStdDev: Marked as regression because -10.115482416281749 (T) = (0 -5164.594104924583) / Math.Sqrt((30526.522649375802 / (54)) + (1245.2627436729356 / (13))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (54) + (13) - 2, .025) and -0.053030205013227694 = (4904.507088530958 - 5164.594104924583) / 4904.507088530958 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

dotnet / perf-autofiling-issues