search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Changes at 7/28/2022 6:38:38 AM #7016

Open performanceautofiler[bot] opened 2 years ago

performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in Microsoft.Extensions.Logging.ScopesOverheadBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FilteredByLevel - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger%3a%20False%2c%20CaptureScopes%3a%20True).html>) 7.04 ns 8.08 ns 1.15 0.10 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'
### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.078665877418512 > 7.386495910738899. IsChangePoint: Marked as a change because one of 6/7/2022 6:20:49 PM, 6/20/2022 7:45:04 PM, 7/7/2022 1:55:17 AM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -14.74695994997527 (T) = (0 -8.172054914590966) / Math.Sqrt((0.06951456668772417 / (43)) + (0.006938840788062895 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.08409690929131027 = (7.538122140697879 - 8.172054914590966) / 7.538122140697879 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Byte).GetHashCodeBenchmark.html>) 110.08 ns 122.24 ns 1.11 0.03 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Byte>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 122.23625734492569 > 115.61030711831377. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -87.87220090076919 (T) = (0 -122.78098488504396) / Math.Sqrt((0.5314591457050986 / (43)) + (0.1560536202529051 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.10477897674090839 = (111.13624305854114 - 122.78098488504396) / 111.13624305854114 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SequenceEqual - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1%3a%20IEnumerable%2c%20input2%3a%20IEnumerable).html>) 1.13 μs 1.21 μs 1.07 0.02 False
[Sum - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Sum(input%3a%20IEnumerable).html>) 461.42 ns 535.94 ns 1.16 0.03 False
[Max - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Max(input%3a%20IEnumerable).html>) 438.09 ns 520.46 ns 1.19 0.01 False
[WhereLast_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input%3a%20IEnumerable).html>) 691.50 ns 779.41 ns 1.13 0.01 False
[WhereLast_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input%3a%20Array).html>) 329.30 ns 389.53 ns 1.18 0.00 False
[WhereAny_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input%3a%20Array).html>) 322.49 ns 383.13 ns 1.19 0.04 False
[Min - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.Min(input%3a%20IEnumerable).html>) 467.93 ns 587.26 ns 1.26 0.05 False

graph graph graph graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1: IEnumerable, input2: IEnumerable) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.210586270019923 > 1.1913534502323544. IsChangePoint: Marked as a change because one of 6/6/2022 10:12:27 PM, 6/17/2022 12:17:51 PM, 6/27/2022 8:54:23 AM, 7/2/2022 7:35:06 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -38.04807786780709 (T) = (0 -1203.1597812731352) / Math.Sqrt((29.308712869848485 / (43)) + (69.10867054517006 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.05779624616150488 = (1137.4211107660105 - 1203.1597812731352) / 1137.4211107660105 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.Sum(input: IEnumerable) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 535.9444311062332 > 484.4611878012788. IsChangePoint: Marked as a change because one of 6/7/2022 6:20:49 PM, 6/10/2022 11:27:32 AM, 6/16/2022 2:51:40 PM, 7/14/2022 4:09:15 PM, 7/24/2022 8:36:55 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -23.06276494907492 (T) = (0 -534.3703759227745) / Math.Sqrt((234.15615204310944 / (43)) + (17.64252489102295 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.11858366478923683 = (477.72052528896927 - 534.3703759227745) / 477.72052528896927 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.Max(input: IEnumerable) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 520.4641445605573 > 459.98709487921536. IsChangePoint: Marked as a change because one of 7/28/2022 6:38:38 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -32.4027579714935 (T) = (0 -520.45479997199) / Math.Sqrt((148.4929929245869 / (44)) + (0.8037569924507074 / (29))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (29) - 2, .025) and -0.12974210735725536 = (460.684608091188 - 520.45479997199) / 460.684608091188 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: IEnumerable) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 779.4085139938919 > 728.2301582687683. IsChangePoint: Marked as a change because one of 6/6/2022 10:51:35 AM, 6/17/2022 12:17:51 PM, 7/14/2022 4:09:15 PM, 7/23/2022 7:50:44 AM, 7/27/2022 9:27:06 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -23.17154821006504 (T) = (0 -772.6129208343615) / Math.Sqrt((227.5352133817789 / (37)) + (126.15003908311989 / (36))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (37) + (36) - 2, .025) and -0.10275958926901588 = (700.6177306030065 - 772.6129208343615) / 700.6177306030065 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: Array) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 389.53372364185776 > 344.5758883882239. IsChangePoint: Marked as a change because one of 7/28/2022 6:38:38 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -266.0186106929185 (T) = (0 -389.70128731476285) / Math.Sqrt((0.7776415624941069 / (44)) + (1.0189301577960428 / (29))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (29) - 2, .025) and -0.1860542050414695 = (328.56954231795606 - 389.70128731476285) / 328.56954231795606 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: Array) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 383.13266715855656 > 338.5882006891632. IsChangePoint: Marked as a change because one of 6/10/2022 11:27:32 AM, 6/17/2022 12:17:51 PM, 7/9/2022 2:25:16 AM, 7/14/2022 4:09:15 PM, 7/24/2022 8:36:55 PM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -19.527639405103404 (T) = (0 -376.3707058023435) / Math.Sqrt((0.1108390222442206 / (20)) + (401.362615904406 / (53))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (53) - 2, .025) and -0.16663145802556484 = (322.61319820684616 - 376.3707058023435) / 322.61319820684616 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Linq.Tests.Perf_Enumerable.Min(input: IEnumerable) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 587.2623881104355 > 491.1978930263206. IsChangePoint: Marked as a change because one of 7/13/2022 7:22:00 AM, 7/28/2022 6:38:38 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -52.76218364646965 (T) = (0 -584.8658527354575) / Math.Sqrt((138.3801741939002 / (44)) + (1.1785217613109822 / (29))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (29) - 2, .025) and -0.19191573116609795 = (490.693962200885 - 584.8658527354575) / 490.693962200885 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address%3a%201020%3a3040%3a5060%3a7080%3a9010%3a1112%3a1314%3a1516).html>) 157.95 ns 167.14 ns 1.06 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 1020:3040:5060:7080:9010:1112:1314:1516) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 167.14160131430853 > 164.82924549992293. IsChangePoint: Marked as a change because one of 7/12/2022 12:16:14 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -31.285317906041808 (T) = (0 -167.5730253181651) / Math.Sqrt((5.162078114029326 / (43)) + (0.7092900148976532 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.076160311899229 = (155.71381277054243 - 167.5730253181651) / 155.71381277054243 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(SByte).GetHashCodeBenchmark.html>) 110.54 ns 122.72 ns 1.11 0.05 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;SByte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<SByte>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 122.71957254676745 > 115.79226931776812. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -48.19916659654569 (T) = (0 -122.69347702629625) / Math.Sqrt((0.5771385773262357 / (43)) + (1.2884612012701142 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.10286470053552843 = (111.24979969593625 - 122.69347702629625) / 111.24979969593625 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Collections.ContainsKeyTrue<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(Int32%2c%20Int32).SortedDictionary(Size%3a%20512).html>) 47.40 μs 51.71 μs 1.09 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyTrue&lt;Int32, Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<Int32, Int32>.SortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.70734961368654 > 49.553424322289146. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -49.09684913554566 (T) = (0 -51651.144334708755) / Math.Sqrt((153159.16191856065 / (43)) + (94765.89605854372 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.08451137654303997 = (47626.18950052012 - 51651.144334708755) / 47626.18950052012 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt16).GetHashCodeBenchmark.html>) 52.36 ns 58.19 ns 1.11 0.04 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt16>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.18900944879536 > 54.98350431349958. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -43.514212561182084 (T) = (0 -57.87496194726464) / Math.Sqrt((0.21848187932822916 / (43)) + (0.3484786192216121 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.10760806056288057 = (52.252203652123015 - 57.87496194726464) / 52.252203652123015 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Tests.Perf_GC<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[AllocateArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_GC(Byte).AllocateArray(length%3a%2010000%2c%20pinned%3a%20True).html>) 897.75 ns 977.68 ns 1.09 0.27 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_GC<Byte>.AllocateArray(length: 10000, pinned: True) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 977.6772657670591 > 943.6120796852703. IsChangePoint: Marked as a change because one of 7/5/2022 1:19:49 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -7.723175243645598 (T) = (0 -950.8866377854117) / Math.Sqrt((327.12140660299804 / (43)) + (818.541178068655 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.0503945607617663 = (905.266147889999 - 950.8866377854117) / 905.266147889999 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Collections.ContainsTrue<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsTrue(Int32).ImmutableList(Size%3a%20512).html>) 770.62 μs 825.69 μs 1.07 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrue&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsTrue<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 825.6911622807016 > 809.1135156250001. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -132.5711107605685 (T) = (0 -823616.0264081678) / Math.Sqrt((4705561.155725448 / (43)) + (2123193.665352329 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.07334066426630431 = (767338.8830107923 - 823616.0264081678) / 767338.8830107923 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>) 4.21 μs 4.78 μs 1.14 0.08 False
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).SortedDictionary(Size%3a%20512).html>) 56.03 μs 60.94 μs 1.09 0.01 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.781664832108555 > 4.394538521042898. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -19.515418459774047 (T) = (0 -4730.801040933251) / Math.Sqrt((15480.017827993264 / (43)) + (8038.814221043037 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.1152916731372442 = (4241.761285301996 - 4730.801040933251) / 4241.761285301996 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsKeyFalse<Int32, Int32>.SortedDictionary(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 60.94455901426718 > 58.43454971085409. IsChangePoint: Marked as a change because one of 6/17/2022 12:17:51 PM, 7/7/2022 8:07:51 AM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -82.2066439222772 (T) = (0 -60614.18036277084) / Math.Sqrt((99453.81078554147 / (43)) + (36026.58393179611 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.08742122141486916 = (55741.215243072336 - 60614.18036277084) / 55741.215243072336 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Reverse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Memory.Span(Int32).Reverse(Size%3a%20512).html>) 43.88 ns 49.95 ns 1.14 0.18 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Memory.Span<Int32>.Reverse(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.94521342796596 > 46.14386264750152. IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -17.437285685259106 (T) = (0 -50.612308354002) / Math.Sqrt((2.3128437120546566 / (43)) + (3.1036362508255166 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.1582352550716305 = (43.69777912767118 - 50.612308354002) / 43.69777912767118 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 2 years ago

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Collections.IterateForEach<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[LinkedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IterateForEach(String).LinkedList(Size%3a%20512).html>) 3.28 μs 3.62 μs 1.11 0.02 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IterateForEach<String>.LinkedList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.620645061550851 > 3.4566680100620197. IsChangePoint: Marked as a change because one of 6/8/2022 9:45:10 AM, 6/20/2022 7:45:04 PM, 7/6/2022 12:32:56 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -12.326483807618235 (T) = (0 -3440.1711513459177) / Math.Sqrt((1091.5426217845368 / (43)) + (6758.9308852700615 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.06014306632855154 = (3245.0065096023236 - 3440.1711513459177) / 3245.0065096023236 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(UInt32).GetHashCodeBenchmark.html>) 25.37 ns 27.14 ns 1.07 0.02 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.14095942141282 > 26.660925481857603. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -23.654336124399542 (T) = (0 -27.510768275542045) / Math.Sqrt((0.14495836114616953 / (43)) + (0.08567952288328874 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.07278896939061065 = (25.6441565494184 - 27.510768275542045) / 25.6441565494184 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int16).GetHashCodeBenchmark.html>) 51.04 ns 54.54 ns 1.07 0.08 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int16>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.54438661669177 > 53.5697114693796. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -23.831558162310003 (T) = (0 -57.64215464599947) / Math.Sqrt((0.40566364107942715 / (43)) + (1.361399436503906 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.1071697638311694 = (52.06261634759494 - 57.64215464599947) / 52.06261634759494 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Collections.ContainsFalse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImmutableList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsFalse(Int32).ImmutableList(Size%3a%20512).html>) 1.53 ms 1.63 ms 1.07 0.01 False
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsFalse(Int32).ImmutableArray(Size%3a%20512).html>) 28.78 μs 32.83 μs 1.14 0.27 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsFalse<Int32>.ImmutableList(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.631716201923077 > 1.6055929125874124. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -73.49039250808379 (T) = (0 -1626902.0771787243) / Math.Sqrt((56588328.38684598 / (43)) + (11527248.534214552 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.06258789020248984 = (1531075.304150791 - 1626902.0771787243) / 1531075.304150791 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Collections.ContainsFalse<Int32>.ImmutableArray(Size: 512) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.82874563242488 > 30.21283828014163. IsChangePoint: Marked as a change because one of 7/14/2022 4:09:15 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -6.0886768873358 (T) = (0 -33647.359691943355) / Math.Sqrt((7972030.636677976 / (43)) + (3275819.095492578 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.10891264236918337 = (30342.66037409045 - 33647.359691943355) / 30342.66037409045 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[GetHashCodeBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Single).GetHashCodeBenchmark.html>) 31.01 ns 36.34 ns 1.17 0.03 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Single>.GetHashCodeBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.34081557870165 > 32.56098595873476. IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -76.50929851482964 (T) = (0 -36.34351388930717) / Math.Sqrt((0.0996668103041819 / (43)) + (0.07727334455218242 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.1726984202324369 = (30.991355716249394 - 36.34351388930717) / 30.991355716249394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.Net.Http.Tests.SocketsHttpHandlerPerfTest

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Get_EnumerateHeaders_Unvalidated - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Net.Http.Tests.SocketsHttpHandlerPerfTest.Get_EnumerateHeaders_Unvalidated(ssl%3a%20False%2c%20chunkedResponse%3a%20False%2c%20responseLength%3a%20100000).html>) 66.88 μs 79.98 μs 1.20 0.22 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Http.Tests.SocketsHttpHandlerPerfTest*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Http.Tests.SocketsHttpHandlerPerfTest.Get_EnumerateHeaders_Unvalidated(ssl: False, chunkedResponse: False, responseLength: 100000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 79.98111252115059 > 69.74903925189395. IsChangePoint: Marked as a change because one of 6/9/2022 1:48:04 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -13.024100093547359 (T) = (0 -77877.40611143362) / Math.Sqrt((6041859.668710302 / (43)) + (15986941.33349877 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.1590684097408374 = (67189.65460273968 - 77877.40611143362) / 67189.65460273968 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in System.IO.Tests.BinaryWriterExtendedTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteAsciiString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars%3a%2032).html>) 25.37 ns 28.96 ns 1.14 0.25 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.963003340467246 > 26.99261889130789. IsChangePoint: Marked as a change because one of 6/30/2022 4:27:12 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -5.116367256741765 (T) = (0 -27.718074665967478) / Math.Sqrt((2.707132712484303 / (43)) + (0.7927704698008398 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.05840872418341808 = (26.18844122562622 - 27.718074665967478) / 26.18844122562622 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x86
OS Windows 10.0.18362
Baseline 34ea1351bdf2697d775e9145f59eb6df2741a084
Compare ee4e89041491fe23ba9158e4675ae83d46a92af9
Diff Diff

Regressions in PerfLabTests.BlockCopyPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CallBlockCopy - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements%3a%201000).html>) 25.08 ns 27.18 ns 1.08 0.41 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.BlockCopyPerf*'
### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 1000) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.180765528134575 > 23.276045174564022. IsChangePoint: Marked as a change because one of 6/17/2022 8:24:28 PM, 7/28/2022 3:42:13 AM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM. IsRegressionStdDev: Marked as regression because -12.96539008646475 (T) = (0 -26.901010074623215) / Math.Sqrt((2.465370738699276 / (43)) + (2.3422789515797175 / (30))) is less than -1.993943367845047 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (30) - 2, .025) and -0.21559069140998477 = (22.129990188901715 - 26.901010074623215) / 22.129990188901715 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)