search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 27 Regressions on 9/19/2023 12:42:36 AM #22025

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 61675a45faf1e52ed4852ada1620401ae081b676
Compare 19445f05aae8a04a2d436e42908429cd90ac1ab8
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_Path

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.32 μs 1.55 μs 1.17 0.27 False
750.19 ns 800.60 ns 1.07 0.16 False
3.41 ns 5.37 ns 1.57 0.69 False
267.79 ns 319.03 ns 1.19 0.32 False
2.45 μs 2.92 μs 1.19 0.34 False

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_Path*'
### Payloads [Baseline]() [Compare]() ### System.IO.Tests.Perf_Path.GetFullPathForTypicalLongPath #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.5482463357475857 > 1.3870273855261437. IsChangePoint: Marked as a change because one of 9/18/2023 8:11:22 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.070263207273818 (T) = (0 -1545.771067831512) / Math.Sqrt((10805.099704704788 / (29)) + (437.86125054929516 / (10))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (10) - 2, .025) and -0.11923585301118542 = (1381.0950244962032 - 1545.771067831512) / 1381.0950244962032 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.IO.Tests.Perf_Path.GetFullPathWithRedundantSegments #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 800.59930393201 > 786.9595536251572. IsChangePoint: Marked as a change because one of 9/15/2023 9:01:53 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -7.233479331269965 (T) = (0 -792.727679116885) / Math.Sqrt((158.46145623179905 / (18)) + (485.9836177746046 / (22))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (22) - 2, .025) and -0.05342712815904528 = (752.5225598682322 - 792.727679116885) / 752.5225598682322 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.IO.Tests.Perf_Path.IsPathRooted #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.367992125242602 > 4.1496884811999335. IsChangePoint: Marked as a change because one of 9/16/2023 11:57:54 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -6.106769485952217 (T) = (0 -5.059363904156566) / Math.Sqrt((0.490966632453526 / (18)) + (0.3177146254008924 / (19))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (19) - 2, .025) and -0.33901223303833866 = (3.7784299346365313 - 5.059363904156566) / 3.7784299346365313 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.IO.Tests.Perf_Path.GetFullPathNoRedundantSegments #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 319.0315959770354 > 289.3916739214084. IsChangePoint: Marked as a change because one of 9/16/2023 6:40:29 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -4.774722484857107 (T) = (0 -313.91600967002137) / Math.Sqrt((446.9757714125632 / (18)) + (356.7776499201227 / (20))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (20) - 2, .025) and -0.11031839992928207 = (282.7261168418133 - 313.91600967002137) / 282.7261168418133 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.IO.Tests.Perf_Path.GetFullPathForReallyLongPath #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.9170724922552664 > 2.566502437703255. IsChangePoint: Marked as a change because one of 9/15/2023 9:01:53 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -5.593297943942828 (T) = (0 -2877.5095904082946) / Math.Sqrt((44163.52704789915 / (17)) + (10328.293678941309 / (22))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (22) - 2, .025) and -0.12064176839957362 = (2567.733660791319 - 2877.5095904082946) / 2567.733660791319 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 61675a45faf1e52ed4852ada1620401ae081b676
Compare 19445f05aae8a04a2d436e42908429cd90ac1ab8
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
120.55 ns 133.92 ns 1.11 0.30 False
58.66 ns 68.07 ns 1.16 0.44 False
77.88 ns 83.66 ns 1.07 0.44 False
701.05 ns 803.59 ns 1.15 0.30 False

graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Memory.Span<Int32>.LastIndexOfAnyValues(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 133.92451325495782 > 127.45138412570157. IsChangePoint: Marked as a change because one of 9/18/2023 8:11:22 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -6.972835980085228 (T) = (0 -133.0832688426146) / Math.Sqrt((48.49659058733389 / (29)) + (3.8254252977820276 / (10))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (10) - 2, .025) and -0.08120502807643148 = (123.08791153088015 - 133.0832688426146) / 123.08791153088015 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Memory.Span<Int32>.SequenceCompareTo(Size: 33) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.06691195876296 > 62.23536501592591. IsChangePoint: Marked as a change because one of 9/17/2023 5:58:59 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -6.994168292972882 (T) = (0 -66.96503208337353) / Math.Sqrt((13.79429775722175 / (26)) + (2.4000980868248205 / (14))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (14) - 2, .025) and -0.0959010610739784 = (61.104997943653856 - 66.96503208337353) / 61.104997943653856 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Memory.Span<Int32>.LastIndexOfValue(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 83.66059105151108 > 77.49133629904108. IsChangePoint: Marked as a change because one of 9/18/2023 2:28:59 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -7.702358656640837 (T) = (0 -83.53212560848709) / Math.Sqrt((38.239290384194334 / (27)) + (2.6031245440646176 / (11))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (11) - 2, .025) and -0.13449228302159585 = (73.62952296688033 - 83.53212560848709) / 73.62952296688033 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Memory.Span<Int32>.SequenceCompareTo(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 803.589870862021 > 733.1518100930637. IsChangePoint: Marked as a change because one of 9/16/2023 11:57:54 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -4.51227694154292 (T) = (0 -785.640715322767) / Math.Sqrt((2494.94372532276 / (21)) + (1738.2430207617567 / (18))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (18) - 2, .025) and -0.09204746506151003 = (719.4199340763229 - 785.640715322767) / 719.4199340763229 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 61675a45faf1e52ed4852ada1620401ae081b676
Compare 19445f05aae8a04a2d436e42908429cd90ac1ab8
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.75 μs 24.70 μs 1.09 0.23 False
22.52 μs 25.58 μs 1.14 0.15 False
20.16 μs 23.28 μs 1.16 0.26 False
26.19 μs 29.15 μs 1.11 0.22 False
12.14 μs 13.97 μs 1.15 0.43 False
23.81 μs 25.73 μs 1.08 0.21 False
12.37 μs 13.87 μs 1.12 0.22 False
11.79 μs 14.41 μs 1.22 0.23 False
12.08 μs 14.17 μs 1.17 0.34 False
23.27 μs 25.47 μs 1.09 0.20 False
22.86 μs 26.14 μs 1.14 0.23 False
26.98 μs 30.47 μs 1.13 0.36 False
22.92 μs 25.18 μs 1.10 0.22 False
22.62 μs 25.95 μs 1.15 0.21 False
11.70 μs 14.24 μs 1.22 0.31 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads [Baseline]() [Compare]() ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: Range) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.701183738360207 > 23.906305153952207. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/18/2023 8:11:22 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -4.426487059804436 (T) = (0 -24592.38504115237) / Math.Sqrt((836005.5667420969 / (29)) + (1039239.4309446139 / (10))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (10) - 2, .025) and -0.07018382130987687 = (22979.589628865757 - 24592.38504115237) / 22979.589628865757 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.584945054385763 > 23.702630085083378. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/19/2023 12:42:36 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -10.6869195641565 (T) = (0 -25036.877527554792) / Math.Sqrt((375113.8262109537 / (30)) + (218582.8901937705 / (9))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (9) - 2, .025) and -0.08917420196013076 = (22987.02767885726 - 25036.877527554792) / 22987.02767885726 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Except(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.28278940217391 > 21.397661662911457. IsChangePoint: Marked as a change because one of 8/22/2023 10:50:09 AM, 9/19/2023 12:42:36 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.01608956225494 (T) = (0 -23683.566334254425) / Math.Sqrt((558545.866098189 / (29)) + (706719.1462940443 / (9))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (9) - 2, .025) and -0.11836830724329447 = (21176.893319368897 - 23683.566334254425) / 21176.893319368897 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.TakeLastHalf(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.152651885660976 > 28.338306084346. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.865848966501446 (T) = (0 -30043.80758681845) / Math.Sqrt((597704.3730182615 / (33)) + (622798.9744695438 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.11487186967120068 = (26948.215668657067 - 30043.80758681845) / 26948.215668657067 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.970131289956694 > 13.136657687486984. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -6.96516133572239 (T) = (0 -14410.803760897958) / Math.Sqrt((198095.3017406776 / (33)) + (397216.17259376723 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.14926127221877358 = (12539.188528537412 - 14410.803760897958) / 12539.188528537412 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.730832690720995 > 25.07265886219542. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -6.476867690137594 (T) = (0 -26135.95027154387) / Math.Sqrt((803029.3776993403 / (32)) + (355587.5397037296 / (6))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (6) - 2, .025) and -0.07755937784416578 = (24254.765731641743 - 26135.95027154387) / 24254.765731641743 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.866191826923078 > 13.053236613038095. IsChangePoint: Marked as a change because one of 9/19/2023 5:34:53 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -7.383992506309741 (T) = (0 -14611.73407592298) / Math.Sqrt((138316.89129502827 / (31)) + (601169.5010172111 / (7))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (7) - 2, .025) and -0.17909623534059876 = (12392.316791429812 - 14611.73407592298) / 12392.316791429812 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.411794033916513 > 12.526723661984231. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -11.718427256144908 (T) = (0 -14187.93145813653) / Math.Sqrt((515061.89909062005 / (33)) + (48573.41531874492 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.14568766152551335 = (12383.769097456217 - 14187.93145813653) / 12383.769097456217 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.172672122383986 > 12.780927444685592. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -10.190580949426309 (T) = (0 -14217.889324369966) / Math.Sqrt((361043.57007440744 / (32)) + (106416.22433771368 / (6))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (6) - 2, .025) and -0.13907706457788385 = (12481.938023779623 - 14217.889324369966) / 12481.938023779623 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.46670663248592 > 24.561397188180354. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -14.277858781140912 (T) = (0 -25100.744829424257) / Math.Sqrt((247128.00621887972 / (32)) + (46757.80576064166 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.08029538651849487 = (23235.075464236954 - 25100.744829424257) / 23235.075464236954 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Select(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.139245411706355 > 23.971083796744132. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.122034280591647 (T) = (0 -26034.959229232394) / Math.Sqrt((474288.1283473532 / (33)) + (606063.8329698725 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.11852944863991051 = (23276.060599825887 - 26034.959229232394) / 23276.060599825887 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSelect(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.465510858619766 > 29.103756337308894. IsChangePoint: Marked as a change because one of 8/10/2023 8:47:51 AM, 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -7.554988559847712 (T) = (0 -31409.25499966826) / Math.Sqrt((758492.0503442494 / (33)) + (1002596.056480512 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.11715545364846987 = (28115.38438727585 - 31409.25499966826) / 28115.38438727585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Select(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.176182339590234 > 24.25671384874812. IsChangePoint: Marked as a change because one of 8/22/2023 4:48:44 PM, 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.365504994387754 (T) = (0 -25067.30477286816) / Math.Sqrt((533788.0303822167 / (33)) + (160893.26541234896 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.07433856128217975 = (23332.77951314653 - 25067.30477286816) / 23332.77951314653 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Where(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.94970949577482 > 24.781514102146257. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.526419857390646 (T) = (0 -25364.378869394626) / Math.Sqrt((386676.0442586237 / (32)) + (164438.17125704922 / (6))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (6) - 2, .025) and -0.0715833364217727 = (23670.00120969711 - 25364.378869394626) / 23670.00120969711 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.238060478058937 > 12.852959653737935. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -11.653944959541127 (T) = (0 -14249.604730136887) / Math.Sqrt((287291.3510943443 / (33)) + (119842.43649662801 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.1607688756964542 = (12276.005179400776 - 14249.604730136887) / 12276.005179400776 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 61675a45faf1e52ed4852ada1620401ae081b676
Compare 19445f05aae8a04a2d436e42908429cd90ac1ab8
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Tests.Perf_Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
240.43 ns 270.88 ns 1.13 0.29 False
171.97 ns 190.55 ns 1.11 0.38 False

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_Encoding*'
### Payloads [Baseline]() [Compare]() ### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 270.8772782913342 > 255.0418611277635. IsChangePoint: Marked as a change because one of 9/18/2023 8:11:22 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -8.740813212939543 (T) = (0 -271.88092159074733) / Math.Sqrt((155.4681438137728 / (30)) + (11.409378500825953 / (10))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (10) - 2, .025) and -0.0879533000781003 = (249.90127937589781 - 271.88092159074733) / 249.90127937589781 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "ascii") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 190.55357412800313 > 181.83506363285485. IsChangePoint: Marked as a change because one of 9/16/2023 5:31:18 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -5.275834305769589 (T) = (0 -191.84997854660813) / Math.Sqrt((65.37408829819823 / (21)) + (34.36265636415635 / (18))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (18) - 2, .025) and -0.06567439735493986 = (180.02682528808978 - 191.84997854660813) / 180.02682528808978 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 61675a45faf1e52ed4852ada1620401ae081b676
Compare 19445f05aae8a04a2d436e42908429cd90ac1ab8
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.MDBenchI.MDNDhrystone

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
647.52 ms 741.31 ms 1.14 0.32 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDNDhrystone*'
### Payloads [Baseline]() [Compare]() ### Benchstone.MDBenchI.MDNDhrystone.Test #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 741.3122859285714 > 680.25361508. IsChangePoint: Marked as a change because one of 9/18/2023 8:11:22 PM, 9/20/2023 11:58:56 PM falls between 9/11/2023 8:56:48 PM and 9/20/2023 11:58:56 PM. IsRegressionStdDev: Marked as regression because -7.291326495098911 (T) = (0 -743171135.223077) / Math.Sqrt((1820030076498436.2 / (30)) + (63340131266497.625 / (10))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (10) - 2, .025) and -0.08732092161762148 = (683488306.3938949 - 743171135.223077) / 683488306.3938949 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik commented 1 year ago

nothing in the range https://github.com/dotnet/runtime/compare/61675a45faf1e52ed4852ada1620401ae081b676...e1ca02f9eccac5531dafa5d506b0846d9bd8ad6b looks related.