search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 33 Regressions on 9/19/2023 3:42:14 PM #22262

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 963954a11c1beeea4ad63002084a213d8d742864
Compare 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.69 μs 30.56 μs 1.10 0.17 False
593.16 ns 664.36 ns 1.12 0.15 False
22.51 μs 24.91 μs 1.11 0.11 False
22.94 μs 27.20 μs 1.19 0.22 False
3.38 μs 4.25 μs 1.26 0.47 False
2.19 μs 2.41 μs 1.10 0.26 False
1.05 μs 1.22 μs 1.17 0.26 False
3.32 μs 3.56 μs 1.07 0.31 False
23.84 μs 27.17 μs 1.14 0.25 False
22.88 μs 26.97 μs 1.18 0.20 False
27.33 μs 32.02 μs 1.17 0.34 False
2.99 μs 3.22 μs 1.08 0.23 False
24.90 μs 26.95 μs 1.08 0.20 False
750.29 ns 809.36 ns 1.08 0.14 False
24.72 μs 28.23 μs 1.14 0.24 False
40.50 μs 44.15 μs 1.09 0.11 False
21.17 μs 23.97 μs 1.13 0.27 False
70.38 μs 81.79 μs 1.16 0.29 False
12.30 μs 14.27 μs 1.16 0.23 True
12.19 μs 14.94 μs 1.23 0.32 False
23.02 μs 26.12 μs 1.13 0.21 False
43.16 μs 46.48 μs 1.08 0.10 False
3.22 μs 3.52 μs 1.09 0.40 False
35.52 μs 39.20 μs 1.10 0.14 False
3.80 μs 4.41 μs 1.16 0.36 False
12.09 μs 15.07 μs 1.25 0.41 False
22.78 μs 26.78 μs 1.18 0.20 False
22.78 μs 27.24 μs 1.20 0.15 False
11.86 μs 13.95 μs 1.18 0.20 False
24.14 μs 27.05 μs 1.12 0.20 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads [Baseline]() [Compare]() ### System.Linq.Tests.Perf_Enumerable.Distinct(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.56295481643925 > 28.331104723936026. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -10.781598133255574 (T) = (0 -29373.86586834479) / Math.Sqrt((477995.3407436298 / (19)) + (556097.2374012674 / (33))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (33) - 2, .025) and -0.08135047605754657 = (27164.05690728303 - 29373.86586834479) / 27164.05690728303 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.ElementAt(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 664.3551097888453 > 621.5748981582856. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -6.49412214619499 (T) = (0 -663.2178454176594) / Math.Sqrt((517.7180453693592 / (46)) + (420.8196101764799 / (5))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (46) + (5) - 2, .025) and -0.10576547845268416 = (599.7816520241806 - 663.2178454176594) / 599.7816520241806 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Reverse(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.91132304414336 > 22.881514301163644. IsChangePoint: Marked as a change because one of 8/24/2023 11:06:19 AM, 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -13.293273519253837 (T) = (0 -23920.30203824763) / Math.Sqrt((220501.89123546716 / (18)) + (372713.1482955135 / (31))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (31) - 2, .025) and -0.09478911371435297 = (21849.232640879913 - 23920.30203824763) / 21849.232640879913 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: Range) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.203199107613276 > 24.18507137993587. IsChangePoint: Marked as a change because one of 9/18/2023 8:11:22 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -5.207344556007354 (T) = (0 -25127.619393351593) / Math.Sqrt((1573550.6567461775 / (14)) + (957472.7523897965 / (37))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (14) + (37) - 2, .025) and -0.0834953873651496 = (23191.25645237594 - 25127.619393351593) / 23191.25645237594 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.250834555161085 > 3.5518604673175984. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -5.45514323856322 (T) = (0 -4022.1555352357636) / Math.Sqrt((62795.40121411619 / (45)) + (66179.62720204933 / (5))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (5) - 2, .025) and -0.19625119488760145 = (3362.3001192602205 - 4022.1555352357636) / 3362.3001192602205 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Average(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 2.4126670397233925 > 2.3066780495909316. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -4.259908329319857 (T) = (0 -2507.3516865016722) / Math.Sqrt((4180.633050286178 / (44)) + (25019.57121865748 / (5))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (5) - 2, .025) and -0.13806787155926023 = (2203.1653376405084 - 2507.3516865016722) / 2203.1653376405084 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Count(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.223676958908423 > 1.1016841816296477. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -8.25246543903882 (T) = (0 -1195.126754055393) / Math.Sqrt((756.8453183961202 / (45)) + (1404.973909583971 / (5))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (5) - 2, .025) and -0.1352840233562271 = (1052.7116822469266 - 1195.126754055393) / 1052.7116822469266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: Array) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.559988304036331 > 3.3210304363581007. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -4.3850011141189595 (T) = (0 -3636.282096736574) / Math.Sqrt((45007.65332528762 / (45)) + (42640.756254741595 / (5))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (5) - 2, .025) and -0.13341661314421932 = (3208.248453892993 - 3636.282096736574) / 3208.248453892993 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Where(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.17095855123792 > 24.908346653115267. IsChangePoint: Marked as a change because one of 9/19/2023 3:42:14 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -9.881242560397261 (T) = (0 -26020.945607680136) / Math.Sqrt((342264.79440508434 / (19)) + (887341.7487192219 / (32))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (32) - 2, .025) and -0.08839752182544842 = (23907.575206564317 - 26020.945607680136) / 23907.575206564317 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.965914671440864 > 24.395380752825425. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -12.798220678697037 (T) = (0 -25743.86664375452) / Math.Sqrt((198898.69447731765 / (17)) + (812096.4758840275 / (31))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (31) - 2, .025) and -0.10714730585658046 = (23252.431277730422 - 25743.86664375452) / 23252.431277730422 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSelect(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.02121883202099 > 28.90782985739299. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -10.618100112168142 (T) = (0 -30821.46652709572) / Math.Sqrt((565552.7590291096 / (18)) + (1228449.183129739 / (33))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (33) - 2, .025) and -0.09921608641837637 = (28039.4973362541 - 30821.46652709572) / 28039.4973362541 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Sum(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.21799367334149 > 3.1133793270655388. IsChangePoint: Marked as a change because one of 8/22/2023 4:48:44 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -4.091985692260723 (T) = (0 -3308.309407202876) / Math.Sqrt((6677.791653243878 / (45)) + (35446.84863420891 / (5))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (5) - 2, .025) and -0.11760281447307833 = (2960.183496641122 - 3308.309407202876) / 2960.183496641122 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.949615113126406 > 25.57965733952387. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -11.655565121295211 (T) = (0 -26661.4912095736) / Math.Sqrt((323904.8607647487 / (18)) + (911694.2781091756 / (33))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (33) - 2, .025) and -0.10299305766684966 = (24171.948340246483 - 26661.4912095736) / 24171.948340246483 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.EmptyTakeSelectToArray #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 809.3586630853704 > 797.9320757399108. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -12.132308189030573 (T) = (0 -811.8521814179318) / Math.Sqrt((377.8800155928149 / (46)) + (16.68041695746653 / (5))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (46) + (5) - 2, .025) and -0.053507074617142866 = (770.6186327348287 - 811.8521814179318) / 770.6186327348287 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Range) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.231671182452946 > 25.26738659317922. IsChangePoint: Marked as a change because one of 9/19/2023 3:42:14 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -11.143006551848773 (T) = (0 -26321.545638072104) / Math.Sqrt((519123.38360596134 / (20)) + (670646.6628803493 / (32))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (32) - 2, .025) and -0.10095075099637366 = (23908.013700204836 - 26321.545638072104) / 23908.013700204836 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Intersect(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.150176400659134 > 42.75993668458208. IsChangePoint: Marked as a change because one of 9/19/2023 3:42:14 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -7.715469668290302 (T) = (0 -42957.36357805408) / Math.Sqrt((613504.1950317762 / (20)) + (1313440.4759136967 / (32))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (32) - 2, .025) and -0.05053057815558668 = (40891.11204499558 - 42957.36357805408) / 40891.11204499558 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Except(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.972848066367266 > 22.103428880375894. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -11.42074705112557 (T) = (0 -24050.792171623896) / Math.Sqrt((618145.8523412538 / (19)) + (531075.309427757 / (31))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (31) - 2, .025) and -0.11835055200096062 = (21505.59332991972 - 24050.792171623896) / 21505.59332991972 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Concat_TenTimes(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 81.7943940008726 > 74.71297470962178. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -5.760651495943287 (T) = (0 -80871.11178964388) / Math.Sqrt((7159698.519446516 / (47)) + (11036046.43811231 / (5))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (47) + (5) - 2, .025) and -0.122862307580444 = (72022.28736656575 - 80871.11178964388) / 72022.28736656575 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.27082201243555 > 13.076169015136426. IsChangePoint: Marked as a change because one of 9/19/2023 5:34:53 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -17.681525982417657 (T) = (0 -14500.171992486417) / Math.Sqrt((72733.13968101032 / (18)) + (348327.99843966326 / (32))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (32) - 2, .025) and -0.17505580124139047 = (12339.98587740912 - 14500.171992486417) / 12339.98587740912 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.939459472315319 > 13.033344287178602. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -9.269638681835817 (T) = (0 -14568.002676515438) / Math.Sqrt((518660.5285180822 / (18)) + (608585.0637392963 / (33))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (33) - 2, .025) and -0.16052720540337978 = (12552.917853788567 - 14568.002676515438) / 12552.917853788567 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Select(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.119364427966104 > 24.107272292166567. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -11.376536878993377 (T) = (0 -25695.324157675837) / Math.Sqrt((498588.80179862917 / (19)) + (553871.3838196077 / (33))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (33) - 2, .025) and -0.10112423476883187 = (23335.53594256353 - 25695.324157675837) / 23335.53594256353 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Zip(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.48189118589743 > 43.67130350522989. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -13.132921787408444 (T) = (0 -45714.31275349201) / Math.Sqrt((516694.70612067694 / (17)) + (1366373.292144087 / (31))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (31) - 2, .025) and -0.0850662220274684 = (42130.435751722034 - 45714.31275349201) / 42130.435751722034 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_FirstElementMatches(input: Array) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.517829993326687 > 3.274364284852609. IsChangePoint: Marked as a change because one of 8/22/2023 10:44:27 PM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -3.032398794293832 (T) = (0 -3700.848751207377) / Math.Sqrt((56649.628348895654 / (47)) + (94627.10549153372 / (5))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (47) + (5) - 2, .025) and -0.13154919886771366 = (3270.603483180967 - 3700.848751207377) / 3270.603483180967 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.GroupBy(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.20050503998317 > 37.2387135323094. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -13.636456561517878 (T) = (0 -37807.48816328631) / Math.Sqrt((486725.5049082185 / (18)) + (459686.84671432374 / (31))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (31) - 2, .025) and -0.07968302818968219 = (35017.21077034858 - 37807.48816328631) / 35017.21077034858 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: List) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.412151715891149 > 3.9405843113809484. IsChangePoint: Marked as a change because one of 8/24/2023 4:35:49 AM, 9/24/2023 11:15:45 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -4.987899088713442 (T) = (0 -4380.95313156074) / Math.Sqrt((21100.93892824752 / (44)) + (61253.44114521628 / (5))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (5) - 2, .025) and -0.14739414527679073 = (3818.176299395274 - 4380.95313156074) / 3818.176299395274 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.065284279595012 > 12.99888304375651. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -12.130704894278754 (T) = (0 -14525.82302556762) / Math.Sqrt((208635.11126299037 / (18)) + (490479.0207814771 / (33))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (33) - 2, .025) and -0.1571771881547621 = (12552.80796602164 - 14525.82302556762) / 12552.80796602164 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.Select(input: IList) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.77521400311325 > 24.778625533963673. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -10.020820190024178 (T) = (0 -25643.261562814096) / Math.Sqrt((368360.6525152769 / (19)) + (764593.9222620297 / (34))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (34) - 2, .025) and -0.08691731594237102 = (23592.651608996646 - 25643.261562814096) / 23592.651608996646 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToList(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.236179941002952 > 23.982693941532464. IsChangePoint: Marked as a change because one of 9/19/2023 12:42:36 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -9.99902867938287 (T) = (0 -25490.6567096573) / Math.Sqrt((524659.0825671982 / (15)) + (630569.5078109837 / (35))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (35) - 2, .025) and -0.09926362434917942 = (23188.847647668757 - 25490.6567096573) / 23188.847647668757 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.949829410908382 > 12.519679906287234. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -7.806243883149051 (T) = (0 -14247.082611027712) / Math.Sqrt((739517.4014411793 / (19)) + (162628.40887045517 / (33))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (33) - 2, .025) and -0.12960713286314154 = (12612.42267027525 - 14247.082611027712) / 12612.42267027525 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IEnumerable) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.046994607626623 > 25.324424262134432. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -10.163012690907628 (T) = (0 -26564.919093896096) / Math.Sqrt((386677.69192794396 / (18)) + (1009692.7595539939 / (31))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (31) - 2, .025) and -0.09762897862215761 = (24202.093431646426 - 26564.919093896096) / 24202.093431646426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 963954a11c1beeea4ad63002084a213d8d742864
Compare 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSetReverse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.71 μs 7.11 μs 1.25 0.27 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSetReverse&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### System.Collections.IndexerSetReverse<Int32>.IList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.1108450698757775 > 5.821906972833265. IsChangePoint: Marked as a change because one of 8/22/2023 4:48:44 PM, 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -12.140522294701736 (T) = (0 -6891.414402379215) / Math.Sqrt((79892.72645439283 / (19)) + (202066.38621529104 / (34))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (34) - 2, .025) and -0.21575779597795944 = (5668.410620254949 - 6891.414402379215) / 5668.410620254949 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 963954a11c1beeea4ad63002084a213d8d742864
Compare 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
214.70 μs 254.21 μs 1.18 0.15 False
39.37 ns 54.22 ns 1.38 0.37 False

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'
### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_String.Concat_CharEnumerable #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 254.2122983870968 > 227.51049662754468. IsChangePoint: Marked as a change because one of 9/19/2023 8:08:41 AM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -11.203982475166415 (T) = (0 -235497.2286151768) / Math.Sqrt((21187222.741068687 / (19)) + (55192083.99711428 / (32))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (32) - 2, .025) and -0.08716263220516589 = (216616.37517608728 - 235497.2286151768) / 216616.37517608728 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### System.Tests.Perf_String.IndexerCheckBoundCheckHoist #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.22048575594293 > 41.69588514716358. IsChangePoint: Marked as a change because one of 9/18/2023 2:28:59 PM, 9/25/2023 11:08:37 PM falls between 9/17/2023 8:50:51 AM and 9/25/2023 11:08:37 PM. IsRegressionStdDev: Marked as regression because -4.237542453654697 (T) = (0 -55.02797943010153) / Math.Sqrt((57.671988887556616 / (13)) + (0.9150055162452829 / (35))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (13) + (35) - 2, .025) and -0.19427745424391477 = (46.07637800961352 - 55.02797943010153) / 46.07637800961352 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)