search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Alpine/x64: 31 Improvements on 12/5/2022 11:02:29 AM #10337

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Int64).MultiplyBenchmark.html>) 7.76 ns 5.36 ns 0.69 0.07 False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Int64).MultiplyOperatorBenchmark.html>) 7.78 ns 5.37 ns 0.69 0.05 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.357479125859345 < 7.3731254992537. IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 26.279276926836722 (T) = (0 -5.413714774994074) / Math.Sqrt((1.1321614079544564 / (292)) + (0.012390383161183906 / (4))) is greater than 1.9680656892939519 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (4) - 2, .975) and 0.288459780603216 = (7.608445211408583 - 5.413714774994074) / 7.608445211408583 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.374026938834736 < 7.53308109047955. IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 26.033849644328335 (T) = (0 -5.446257768902129) / Math.Sqrt((0.3639460248659193 / (292)) + (0.015559114115545801 / (3))) is greater than 1.9680934526838334 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (3) - 2, .975) and 0.27713719446351764 = (7.5342896704446085 - 5.446257768902129) / 7.5342896704446085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 21a3647f09ca92cbf890129d4e917cbd01a1b374
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).DotBenchmark.html>) 42.35 ns 13.66 ns 0.32 0.03 False
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).SumBenchmark.html>) 20.91 ns 7.71 ns 0.37 0.06 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).DivideBenchmark.html>) 40.05 ns 30.51 ns 0.76 0.01 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).SquareRootBenchmark.html>) 51.12 ns 29.54 ns 0.58 0.01 False

graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.658706860309213 < 40.23277712083166. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 106.17680332293513 (T) = (0 -13.561947487988924) / Math.Sqrt((5.331047357916753 / (97)) + (0.018724752263632908 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.6650560438063764 = (40.49019914289501 - 13.561947487988924) / 40.49019914289501 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SumBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.706823675514017 < 20.064142934080028. IsChangePoint: Marked as a change because one of 11/18/2022 8:48:12 PM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 51.83856881452201 (T) = (0 -8.022590520540307) / Math.Sqrt((2.5285854975285664 / (97)) + (0.07481867377503232 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.5933861186468575 = (19.73024259241342 - 8.022590520540307) / 19.73024259241342 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.506085209442652 < 38.03653902326601. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 692.9040073598362 (T) = (0 -30.51403364125623) / Math.Sqrt((0.011931895532801745 / (97)) + (0.00020560721749066942 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.2391238108972131 = (40.103809369087884 - 30.51403364125623) / 40.103809369087884 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.543829292395326 < 48.57632643865083. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 326.1102965354627 (T) = (0 -29.595254304494926) / Math.Sqrt((0.17426898308214042 / (97)) + (0.00528906373888793 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.42340699330817544 = (51.32780654815138 - 29.595254304494926) / 51.32780654815138 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyOperatorBenchmark.html>) 43.09 ns 24.29 ns 0.56 0.08 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Byte).SquareRootBenchmark.html>) 52.05 ns 29.39 ns 0.56 0.05 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 24.29212669889487 < 40.826288747097806. IsChangePoint: Marked as a change because one of 11/1/2022 2:33:16 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 169.52763855250257 (T) = (0 -24.223002825795152) / Math.Sqrt((2.9962150796741067 / (299)) + (0.00955621966461138 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.4598645169509295 = (44.84616098364071 - 24.223002825795152) / 44.84616098364071 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Byte>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.389241633556995 < 49.47539935679409. IsChangePoint: Marked as a change because one of 11/3/2022 3:03:31 PM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 229.36524150059384 (T) = (0 -29.47953032356745) / Math.Sqrt((2.2608439017859108 / (292)) + (0.009803150114538828 / (3))) is greater than 1.9680934526838334 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (3) - 2, .975) and 0.449462905242928 = (53.5468556148346 - 29.47953032356745) / 53.5468556148346 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Int16).DivisionOperatorBenchmark.html>) 39.09 ns 31.07 ns 0.79 0.06 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Int16).SquareRootBenchmark.html>) 27.69 ns 15.96 ns 0.58 0.08 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.07275629822745 < 37.054887835321985. IsChangePoint: Marked as a change because one of 11/4/2022 9:11:54 AM, 11/5/2022 3:01:26 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 80.59594406448969 (T) = (0 -31.147507442113763) / Math.Sqrt((1.3448835209856809 / (299)) + (0.011175467024625232 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.20626209438304188 = (39.24155218201828 - 31.147507442113763) / 39.24155218201828 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<Int16>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.958566344524977 < 26.345609686590663. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 112.90886804353823 (T) = (0 -15.945635236563254) / Math.Sqrt((3.5130510123445258 / (292)) + (9.517893053007091E-05 / (4))) is greater than 1.9680656892939519 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (4) - 2, .975) and 0.4373926488119428 = (28.34238692916272 - 15.945635236563254) / 28.34238692916272 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DivisionOperatorBenchmark.html>) 14.57 ns 12.77 ns 0.88 0.01 False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MultiplyBenchmark.html>) 7.76 ns 6.24 ns 0.80 0.01 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 12.772380531058447 < 13.922351260072848. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 39.508082730944786 (T) = (0 -12.731590437101506) / Math.Sqrt((0.025145569498073724 / (97)) + (0.008206266565419182 / (4))) is greater than 1.984216951586017 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (4) - 2, .975) and 0.12980748972118472 = (14.630774554727232 - 12.731590437101506) / 14.630774554727232 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.235137740525956 < 7.375629315069926. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 365.9358454529705 (T) = (0 -6.234344860253087) / Math.Sqrt((0.0016436749777655171 / (97)) + (1.2573182542122838E-06 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.19747242700274237 = (7.768387118425388 - 6.234344860253087) / 7.768387118425388 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(SByte).DotBenchmark.html>) 80.94 ns 23.01 ns 0.28 0.02 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(SByte).DivideBenchmark.html>) 76.65 ns 62.29 ns 0.81 0.07 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;SByte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<SByte>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 23.010975342691253 < 76.67219811966811. IsChangePoint: Marked as a change because one of 11/18/2022 8:48:12 PM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 255.4873687665258 (T) = (0 -23.003019287598285) / Math.Sqrt((12.138989637595373 / (292)) + (0.0003806918748653207 / (4))) is greater than 1.9680656892939519 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (4) - 2, .975) and 0.6939231995734634 = (75.15440325938515 - 23.003019287598285) / 75.15440325938515 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<SByte>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 62.28697878637261 < 72.58142951467377. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 9.784669677443834 (T) = (0 -63.73431372670581) / Math.Sqrt((1.39689088405166 / (292)) + (7.375969664986104 / (4))) is greater than 1.9680656892939519 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (4) - 2, .975) and 0.17269530320774965 = (77.03850101882176 - 63.73431372670581) / 77.03850101882176 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).DivideBenchmark.html>) 17.75 ns 15.34 ns 0.86 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.337444271080058 < 16.86592213993048. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 21.090340107235757 (T) = (0 -15.231165012978964) / Math.Sqrt((0.03544268016028548 / (97)) + (0.0378715759867994 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.13630257878872537 = (17.63483905233656 - 15.231165012978964) / 17.63483905233656 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SumBenchmark.html>) 21.54 ns 7.79 ns 0.36 0.07 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SquareRootBenchmark.html>) 51.96 ns 29.16 ns 0.56 0.01 False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).DotBenchmark.html>) 37.83 ns 13.58 ns 0.36 0.04 False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).DivideBenchmark.html>) 39.94 ns 30.41 ns 0.76 0.01 False

graph graph graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SumBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.790002400105935 < 19.994113724842066. IsChangePoint: Marked as a change because one of 11/18/2022 7:31:41 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 52.883634275560276 (T) = (0 -8.08706529858096) / Math.Sqrt((2.5599276925827508 / (97)) + (0.06888040129272052 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.5922877232090764 = (19.835226356767368 - 8.08706529858096) / 19.835226356767368 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 29.159552654531037 < 48.62408424813631. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 415.6326420782507 (T) = (0 -29.202119925602197) / Math.Sqrt((0.10296696472679402 / (97)) + (0.003623945132891265 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.4327711197535418 = (51.482075300739304 - 29.202119925602197) / 51.482075300739304 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DotBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 13.584886378208251 < 35.93248552124356. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 186.1264402526874 (T) = (0 -13.54223314515309) / Math.Sqrt((1.5297175002895298 / (97)) + (0.003638596580115682 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.6457452520332637 = (38.227386429905174 - 13.54223314515309) / 38.227386429905174 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.41130988163907 < 37.914735142859655. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 824.1824530792844 (T) = (0 -30.421114773956234) / Math.Sqrt((0.010224878155385959 / (97)) + (8.90780044917655E-05 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.23948980693560465 = (40.000929706645444 - 30.421114773956234) / 40.000929706645444 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).DivideBenchmark.html>) 17.82 ns 15.33 ns 0.86 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.333573910908203 < 16.88402741109921. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 109.07405027637388 (T) = (0 -15.329399160851645) / Math.Sqrt((0.03226690189857987 / (97)) + (0.0003110459389075463 / (3))) is greater than 1.9844674545082206 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (3) - 2, .975) and 0.12939700556678788 = (17.607795124609616 - 15.329399160851645) / 17.607795124609616 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Threading.Tests.Perf_SemaphoreSlim

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ReleaseWaitAsync - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync.html>) 32.21 ns 30.25 ns 0.94 0.06 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_SemaphoreSlim*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 30.247057220177325 < 30.576632551188485. IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 11/2/2022 9:35:40 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 34.76241318567693 (T) = (0 -30.155392795737956) / Math.Sqrt((1.044789071525087 / (299)) + (0.006859310510393687 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08058381753421577 = (32.798414222886684 - 30.155392795737956) / 32.798414222886684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).DivisionOperatorBenchmark.html>) 25.06 ns 20.35 ns 0.81 0.01 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).SquareRootBenchmark.html>) 30.17 ns 19.87 ns 0.66 0.01 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.34559646410535 < 23.800665365598956. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 33.51770283947125 (T) = (0 -20.19604080310691) / Math.Sqrt((0.01657984185768186 / (97)) + (0.04473379147335814 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.19945676481886324 = (25.2279201366772 - 20.19604080310691) / 25.2279201366772 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.874942261531213 < 28.65341167295063. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 296.09973606183445 (T) = (0 -19.83776570416622) / Math.Sqrt((0.09689718073067238 / (97)) + (0.0007049772688241048 / (4))) is greater than 1.984216951586017 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (4) - 2, .975) and 0.3384842407011699 = (29.988349370834563 - 19.83776570416622) / 29.988349370834563 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivisionOperatorBenchmark.html>) 17.70 ns 14.96 ns 0.85 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 14.963634601702257 < 16.786556821105037. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 27.28066940483882 (T) = (0 -14.784614517909016) / Math.Sqrt((0.029997725783470694 / (97)) + (0.04059471922160401 / (4))) is greater than 1.984216951586017 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (4) - 2, .975) and 0.1587436419390103 = (17.57444609629584 - 14.784614517909016) / 17.57444609629584 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare a83c661bb8061b65404fb154b328ff1d3993d9ec
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(Int32).DivideBenchmark.html>) 19.00 ns 15.59 ns 0.82 0.07 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int32&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int32>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.588759904977877 < 18.267911863198247. IsChangePoint: Marked as a change because one of 11/21/2022 6:40:27 PM, 11/22/2022 6:55:51 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 33.4038060985726 (T) = (0 -15.496617831576657) / Math.Sqrt((2.2601263809708065 / (292)) + (0.016980323381352014 / (2))) is greater than 1.9681214070095314 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (2) - 2, .975) and 0.21544871867075463 = (19.752205114394982 - 15.496617831576657) / 19.752205114394982 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).SquareRootBenchmark.html>) 29.83 ns 19.83 ns 0.66 0.01 False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).DivisionOperatorBenchmark.html>) 25.07 ns 20.17 ns 0.80 0.01 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 19.829217897169098 < 28.254396106096507. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 90.02765932689215 (T) = (0 -19.929376606150225) / Math.Sqrt((0.07390176548926125 / (97)) + (0.046161640938788995 / (4))) is greater than 1.984216951586017 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (4) - 2, .975) and 0.33379662917380515 = (29.914854050400145 - 19.929376606150225) / 29.914854050400145 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 20.16900302158017 < 23.817637763269946. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 31.826391018386463 (T) = (0 -20.323048555781316) / Math.Sqrt((0.01800434542790438 / (97)) + (0.04746005321463259 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.19496414601565068 = (25.24489866531636 - 20.323048555781316) / 25.24489866531636 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 21a3647f09ca92cbf890129d4e917cbd01a1b374
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).MultiplyBenchmark.html>) 7.76 ns 6.23 ns 0.80 0.01 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.233394824810821 < 7.374683180025253. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 309.0981195036147 (T) = (0 -6.232373068133589) / Math.Sqrt((0.002298642707282934 / (97)) + (2.0879734149351287E-06 / (2))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (97) + (2) - 2, .975) and 0.1978770477297462 = (7.769847565755429 - 6.232373068133589) / 7.769847565755429 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 21a3647f09ca92cbf890129d4e917cbd01a1b374
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(UInt16).DivideBenchmark.html>) 38.59 ns 31.16 ns 0.81 0.04 False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_VectorOf(UInt16).SquareRootBenchmark.html>) 27.89 ns 15.70 ns 0.56 0.07 False

graph graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt16&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt16>.DivideBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 31.160841276066563 < 36.47309416542481. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 125.88057459666699 (T) = (0 -31.126047147208343) / Math.Sqrt((0.7205370869933728 / (299)) + (0.0024212628060048167 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.19571577774431378 = (38.70030803279044 - 31.126047147208343) / 38.70030803279044 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.SquareRootBenchmark ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.702032414935644 < 26.313083566836713. IsChangePoint: Marked as a change because one of 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 99.57974542168107 (T) = (0 -15.795412447310266) / Math.Sqrt((1.999319938587973 / (292)) + (0.017439660892570534 / (2))) is greater than 1.9681214070095314 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (2) - 2, .975) and 0.44026967966300384 = (28.219683432193456 - 15.795412447310266) / 28.219683432193456 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS alpine 3.15
Baseline 0eaf12b95e6508f6b09593e7bb553961127b4d59
Compare 440d362310101f5451b6b292fb60fcf6f4f71923
Diff Diff

Improvements in System.Numerics.Tests.Perf_BigInteger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToStringD - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20123).html>) 28.46 ns 25.95 ns 0.91 0.31 False

graph Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 123) ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 25.95214731617663 < 27.876181499715674. IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 11/29/2022 11:47:49 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM. IsImprovementStdDev: Marked as improvement because 6.555226471222115 (T) = (0 -23.293058305666012) / Math.Sqrt((2.164062696151712 / (292)) + (3.7778138185298027 / (4))) is greater than 1.9680656892939519 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (292) + (4) - 2, .975) and 0.21541999707433487 = (29.688569959477935 - 23.293058305666012) / 29.688569959477935 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)