[Perf] Linux/x64: 4 Regressions on 10/18/2022 8:25:03 PM

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	e8fa4a736d6bdcfbbe2c2dc1dd1303214bb97085
Compare	51e3afb2ba42609c3711cb50fb5eaa6800bc1fde
Diff	Diff

Regressions in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ReadAllBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.ReadAllBytes(size%3a%20512).html>)	8.03 μs	14.92 μs	1.86	0.27	False
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.CopyTo(size%3a%204096).html>)	31.70 μs	47.28 μs	1.49	0.14	False
[CopyTo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.CopyTo(size%3a%20512).html>)	30.86 μs	47.50 μs	1.54	0.11	False
[ReadAllBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.IO.Tests.Perf_File.ReadAllBytes(size%3a%204096).html>)	8.34 μs	14.76 μs	1.77	0.20	False

graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

Related Issues

Regressions

### Payloads [Baseline]() [Compare]() ### Histogram ### Edge Detector Info [Collection Data]() #### System.IO.Tests.Perf_File.ReadAllBytes(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionWindowed: Marked as regression because 14.924441233027592 > 8.394361535978167. IsChangePoint: Marked as a change because one of 9/7/2022 3:19:02 AM, 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM. IsRegressionStdDev: Marked as regression because -60.71352199521391 (T) = (0 -14413.039266632813) / Math.Sqrt((93647.87851033843 / (19)) + (155029.00381426577 / (25))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (25) - 2, .025) and -0.7998669786230697 = (8007.835822211176 - 14413.039266632813) / 8007.835822211176 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyTo(size: 4096) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionWindowed: Marked as regression because 47.277597728413646 > 33.13777048314447. IsChangePoint: Marked as a change because one of 9/7/2022 3:19:02 AM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM. IsRegressionStdDev: Marked as regression because -49.58415169741604 (T) = (0 -46979.61434923627) / Math.Sqrt((235323.85979796408 / (19)) + (2144672.296925887 / (25))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (25) - 2, .025) and -0.4940878695265783 = (31443.675641461694 - 46979.61434923627) / 31443.675641461694 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.CopyTo(size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionWindowed: Marked as regression because 47.500685832616185 > 32.42837908023321. IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM. IsRegressionStdDev: Marked as regression because -65.50936510262702 (T) = (0 -46525.14556955652) / Math.Sqrt((274538.68858025665 / (20)) + (988162.0125911582 / (25))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (25) - 2, .025) and -0.4813271571741907 = (31407.74496992873 - 46525.14556955652) / 31407.74496992873 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 4096) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionWindowed: Marked as regression because 14.759140554764166 > 8.903511269249764. IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM. IsRegressionStdDev: Marked as regression because -52.64045446409999 (T) = (0 -14967.03827386326) / Math.Sqrt((164059.0304484875 / (19)) + (138689.80489963476 / (24))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (24) - 2, .025) and -0.7308458599639482 = (8647.239260331944 - 14967.03827386326) / 8647.239260331944 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

dotnet / perf-autofiling-issues