search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Windows/x86: 24 Regressions on 9/12/2023 12:17:30 AM #21753

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.CastingPerf2.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
334.82 μs 374.20 μs 1.12 0.06 False
339.01 μs 374.20 μs 1.10 0.05 False
338.52 μs 374.20 μs 1.11 0.05 False

graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
### Payloads [Baseline]() [Compare]() ### PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 374.19803113553115 > 355.23516606695875. IsChangePoint: Marked as a change because one of 6/9/2023 2:21:24 AM, 6/26/2023 10:42:28 PM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -31.391440849674716 (T) = (0 -374473.3909516985) / Math.Sqrt((25001584.973691497 / (17)) + (281127.5683337704 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.11368676922060544 = (336246.6011998753 - 374473.3909516985) / 336246.6011998753 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 374.20410714285714 > 356.29092126259803. IsChangePoint: Marked as a change because one of 6/9/2023 2:21:24 AM, 6/26/2023 10:42:28 PM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -54.36122268287722 (T) = (0 -374259.03794488806) / Math.Sqrt((7743694.783543872 / (17)) + (67578.430922288 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.1090745645001177 = (337451.6465568518 - 374259.03794488806) / 337451.6465568518 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 374.2034126984127 > 354.1431345990524. IsChangePoint: Marked as a change because one of 6/7/2023 8:31:22 AM, 6/26/2023 10:42:28 PM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -38.06809737770465 (T) = (0 -374312.6924214502) / Math.Sqrt((15796460.454975247 / (17)) + (132948.80447833997 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.10906508063593455 = (337502.91029523755 - 374312.6924214502) / 337502.91029523755 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
285.12 ns 377.85 ns 1.33 0.07 False
304.97 ns 334.68 ns 1.10 0.03 False
652.48 ns 709.92 ns 1.09 0.05 False
653.59 ns 714.25 ns 1.09 0.06 False
461.61 ns 523.44 ns 1.13 0.05 False
1.19 μs 1.30 μs 1.09 0.05 False
9.80 μs 11.61 μs 1.18 0.04 False
696.14 ns 749.06 ns 1.08 0.03 False

graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads [Baseline]() [Compare]() ### System.Linq.Tests.Perf_Enumerable.Count(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 377.84962873795223 > 298.48038431725917. IsChangePoint: Marked as a change because one of 6/16/2023 2:41:30 PM, 8/22/2023 10:44:27 PM, 8/28/2023 1:23:07 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -680.8262395441365 (T) = (0 -377.68651232144896) / Math.Sqrt((0.25547369901701994 / (17)) + (0.08559946882182874 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.3277241483281437 = (284.46158247330806 - 377.68651232144896) / 284.46158247330806 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 334.68033284874264 > 319.9657002518723. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/7/2023 12:50:30 AM, 7/14/2023 2:57:02 AM, 7/27/2023 4:03:50 PM, 8/10/2023 8:47:51 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -44.40777735156293 (T) = (0 -336.3801212638084) / Math.Sqrt((5.955393965849218 / (17)) + (3.0723312620071934 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.10112069980179458 = (305.48887267704436 - 336.3801212638084) / 305.48887267704436 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 709.9173424239679 > 681.6292915953535. IsChangePoint: Marked as a change because one of 5/26/2023 6:22:05 AM, 6/2/2023 1:14:24 PM, 7/12/2023 9:48:15 PM, 8/19/2023 11:06:43 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -41.90032387785269 (T) = (0 -704.5797543779775) / Math.Sqrt((9.711870536589302 / (17)) + (25.451346628618285 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.08346009602134206 = (650.3052184065841 - 704.5797543779775) / 650.3052184065841 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_LastElementMatches(input: Array) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 714.2459621131692 > 686.3015953679753. IsChangePoint: Marked as a change because one of 5/26/2023 6:22:05 AM, 6/5/2023 10:43:22 AM, 7/14/2023 2:57:02 AM, 8/8/2023 9:37:01 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -180.39950406433735 (T) = (0 -714.056357691483) / Math.Sqrt((0.9556641891339901 / (17)) + (1.2557116246161517 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.0918221724624642 = (654.0042652559628 - 714.056357691483) / 654.0042652559628 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Contains_ElementNotFound(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 523.437590230123 > 484.62233246599317. IsChangePoint: Marked as a change because one of 7/14/2023 2:26:40 PM, 8/28/2023 1:23:07 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -450.00837463555797 (T) = (0 -523.684282075759) / Math.Sqrt((0.17506527029722213 / (17)) + (0.20180093413673192 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.13465130842896236 = (461.53763555858586 - 523.684282075759) / 461.53763555858586 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Reverse(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.295712199807592 > 1.2486142367627062. IsChangePoint: Marked as a change because one of 7/5/2023 7:07:19 PM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 8/22/2023 10:44:27 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -110.46186024915767 (T) = (0 -1291.3209686380508) / Math.Sqrt((5.161809037086764 / (17)) + (12.168823725326291 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.08466882488789151 = (1190.5209581104336 - 1291.3209686380508) / 1190.5209581104336 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Concat_TenTimes(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.60616215045781 > 10.226626756227981. IsChangePoint: Marked as a change because one of 6/26/2023 10:42:28 PM, 8/28/2023 1:23:07 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -83.58092614953489 (T) = (0 -11621.887716579324) / Math.Sqrt((8511.303284378155 / (17)) + (382.1303791052233 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.19555159444437076 = (9720.942007509566 - 11621.887716579324) / 9720.942007509566 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 749.0563065229939 > 721.230403179621. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 6/2/2023 6:53:36 PM, 6/9/2023 2:21:24 AM, 6/16/2023 8:27:26 PM, 7/14/2023 2:57:02 AM, 9/2/2023 3:43:46 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -75.81130258010596 (T) = (0 -750.868419092388) / Math.Sqrt((6.396019282405864 / (17)) + (7.2094068886114435 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.09152285805639955 = (687.9090195412016 - 750.868419092388) / 687.9090195412016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsTrue<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
34.52 μs 36.75 μs 1.06 0.05 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Collections.ContainsTrue<Int32>.SortedSet(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.74622858255451 > 36.08276586538462. IsChangePoint: Marked as a change because one of 5/26/2023 6:22:05 AM, 8/14/2023 10:44:26 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -23.91639926519503 (T) = (0 -36661.378768401264) / Math.Sqrt((38917.55756932536 / (17)) + (163370.63353094517 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.06748971310405334 = (34343.54291040152 - 36661.378768401264) / 34343.54291040152 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.LowLevelPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
37.75 μs 62.37 μs 1.65 0.23 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'
### Payloads [Baseline]() [Compare]() ### PerfLabTests.LowLevelPerf.GenericClassGenericStaticField #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.37061088977425 > 39.62569549183021. IsChangePoint: Marked as a change because one of 6/8/2023 12:15:18 PM, 6/26/2023 10:42:28 PM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -54.22426067608146 (T) = (0 -62417.26387712885) / Math.Sqrt((3727186.3513579597 / (17)) + (7470.767866746086 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.6865593925309684 = (37008.636727261146 - 62417.26387712885) / 37008.636727261146 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
155.93 μs 223.15 μs 1.43 0.06 False
155.93 μs 221.60 μs 1.42 0.06 False
218.45 μs 280.65 μs 1.28 0.08 False
155.92 μs 228.54 μs 1.47 0.04 False
156.28 μs 223.05 μs 1.43 0.05 False
155.92 μs 222.77 μs 1.43 0.06 False
155.93 μs 229.55 μs 1.47 0.06 False
155.92 μs 227.77 μs 1.46 0.06 False

graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'
### Payloads [Baseline]() [Compare]() ### PerfLabTests.CastingPerf.ObjObjrefValueType #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 223.14640258215962 > 163.71917581992574. IsChangePoint: Marked as a change because one of 6/6/2023 5:17:50 PM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -167.66064069543785 (T) = (0 -224599.9546752966) / Math.Sqrt((57624.750349519236 / (17)) + (3763606.17056406 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.43901183439981545 = (156079.29643537157 - 224599.9546752966) / 156079.29643537157 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.ObjInt #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 221.5982687793427 > 163.7234190903465. IsChangePoint: Marked as a change because one of 6/7/2023 8:31:22 AM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -143.17622270217075 (T) = (0 -224090.3846147111) / Math.Sqrt((54751.504404987536 / (17)) + (5118990.43777308 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.4359475751950995 = (156057.49714383853 - 224090.3846147111) / 156057.49714383853 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.FooObjIsFoo2 #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 280.64779761904765 > 229.360472255609. IsChangePoint: Marked as a change because one of 6/7/2023 2:16:19 PM, 6/22/2023 7:55:14 AM, 7/5/2023 7:07:19 PM, 7/14/2023 2:26:40 PM, 8/28/2023 1:23:07 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -139.53325914633567 (T) = (0 -280692.0193738553) / Math.Sqrt((3276000.9339410258 / (17)) + (39415.48152875431 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.28071883493782973 = (219167.5578718892 - 280692.0193738553) / 219167.5578718892 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.ObjFooIsObj #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 228.53551932367154 > 163.71538306835492. IsChangePoint: Marked as a change because one of 6/7/2023 8:50:18 PM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -158.37127904999195 (T) = (0 -224879.8358811501) / Math.Sqrt((37312.770518703444 / (17)) + (4299165.282716258 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.4414603614276651 = (156008.33841759092 - 224879.8358811501) / 156008.33841759092 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.ObjScalarValueType #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 223.0508393719807 > 163.74490265613102. IsChangePoint: Marked as a change because one of 6/5/2023 10:43:22 AM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -151.12921664101094 (T) = (0 -224948.479457265) / Math.Sqrt((21453.703232283195 / (17)) + (4760608.816271396 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.4421403672258146 = (155982.37492650526 - 224948.479457265) / 155982.37492650526 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.IFooFooIsIFoo #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 222.7711400462963 > 163.73585943450115. IsChangePoint: Marked as a change because one of 6/6/2023 4:05:41 PM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -186.87482768370816 (T) = (0 -223081.44956334113) / Math.Sqrt((42980.56301999715 / (17)) + (2902418.874245328 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.42968668916213787 = (156035.20075722123 - 223081.44956334113) / 156035.20075722123 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.ObjFooIsObj2 #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 229.55451593137255 > 163.72069610386518. IsChangePoint: Marked as a change because one of 6/5/2023 10:43:22 AM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -163.0806745296586 (T) = (0 -224129.62090642296) / Math.Sqrt((30695.335911366008 / (17)) + (3974330.6534560216 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.436861099039322 = (155985.58625901619 - 224129.62090642296) / 155985.58625901619 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### PerfLabTests.CastingPerf.FooObjIsNull #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 227.7684299516908 > 163.72618561976395. IsChangePoint: Marked as a change because one of 6/6/2023 5:17:50 PM, 6/28/2023 3:57:02 AM, 7/14/2023 2:26:40 PM, 8/8/2023 9:37:01 AM, 9/1/2023 1:30:05 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -205.81844561442338 (T) = (0 -225279.2155087105) / Math.Sqrt((21164.99063288602 / (17)) + (2578677.4248749577 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.44426584747926307 = (155981.82003811808 - 225279.2155087105) / 155981.82003811808 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEachNonGeneric<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.92 μs 3.32 μs 1.13 0.06 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Collections.IterateForEachNonGeneric<String>.ArrayList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.3156144323671493 > 3.0685024087890787. IsChangePoint: Marked as a change because one of 6/9/2023 2:21:24 AM, 7/1/2023 6:36:20 PM, 7/5/2023 7:07:19 PM, 8/14/2023 10:44:26 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -98.09935816583602 (T) = (0 -3310.2123536641266) / Math.Sqrt((11.13422382754795 / (17)) + (342.61424783195554 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.13233252843473203 = (2923.3571151046626 - 3310.2123536641266) / 2923.3571151046626 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEach<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.78 μs 4.99 μs 1.32 0.06 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Collections.IterateForEach<String>.ConcurrentStack(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.986338496752901 > 3.9596746521415875. IsChangePoint: Marked as a change because one of 6/5/2023 10:43:22 AM, 6/9/2023 2:21:24 AM, 8/22/2023 10:44:27 PM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -374.30620189108487 (T) = (0 -4982.676921112454) / Math.Sqrt((114.24204481690302 / (17)) + (84.69115217930724 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.31976071203659123 = (3775.4396502858663 - 4982.676921112454) / 3775.4396502858663 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 9d08b24d743d0c57203a55c3d0c6dd1bc472e57e
Compare d67314ee8018b27748a8d0a1f4e38172ff680599
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEach<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.97 μs 3.16 μs 1.07 0.12 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Collections.IterateForEach<Int32>.ConcurrentStack(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.1624304411966517 > 3.0988190862743323. IsChangePoint: Marked as a change because one of 6/5/2023 10:43:22 AM, 7/17/2023 6:26:12 PM, 8/10/2023 8:47:51 AM, 9/11/2023 8:56:48 PM, 9/18/2023 2:28:59 PM falls between 9/9/2023 3:11:42 PM and 9/18/2023 2:28:59 PM. IsRegressionStdDev: Marked as regression because -7.866180985710471 (T) = (0 -3159.213655729714) / Math.Sqrt((5978.741529300998 / (17)) + (5878.673943395764 / (23))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (23) - 2, .025) and -0.0653705231640495 = (2965.3661210253395 - 3159.213655729714) / 2965.3661210253395 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)