[Perf] Linux/x64: 861 Regressions on 4/17/2023 1:30:24 AM

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int64>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.658192767533755 > 3.6080887409724007. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.18771272169973 (T) = (0 -28.032652824257276) / Math.Sqrt((2.684771315160246 / (33)) + (7.5174644528206755 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.0692799295604045 = (3.9654184165261164 - 28.032652824257276) / 3.9654184165261164 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.528408476804724 > 2.532915308260882. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.685991345187684 (T) = (0 -19.06015569313751) / Math.Sqrt((0.2919618355380917 / (33)) + (3.0980160678742954 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.558396225824628 = (2.5217195716751446 - 19.06015569313751) / 2.5217195716751446 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.59337241903952 > 3.42473828470203. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.719445716008785 (T) = (0 -29.181207402170767) / Math.Sqrt((0.7211638535571971 / (33)) + (4.9791821308417505 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.080094427682849 = (3.611493363517429 - 29.181207402170767) / 3.611493363517429 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.96978646450084 > 3.830478858674154. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.65882693627527 (T) = (0 -40.87586732498882) / Math.Sqrt((0.5091529375403786 / (32)) + (3.3114817521853723 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.587267982087154 = (3.5276535753017138 - 40.87586732498882) / 3.5276535753017138 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.75620292226872 > 3.8398252894013187. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.67691464499029 (T) = (0 -32.24801691723308) / Math.Sqrt((1.385315921119606 / (31)) + (13.046247454921607 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.616626465142963 = (3.74253393107926 - 32.24801691723308) / 3.74253393107926 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.28610331930184 > 4.4177369790761185. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.192159755254167 (T) = (0 -29.38074417520435) / Math.Sqrt((0.9199043231992556 / (32)) + (3.0309443634320523 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.41372121749134 = (3.492003528013803 - 29.38074417520435) / 3.492003528013803 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.67099541195775 > 25.518937139591365. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/3/2023 9:00:24 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.508551884215574 (T) = (0 -35.17940126769312) / Math.Sqrt((5.576429713729537 / (33)) + (4.832241119412921 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3962944245447838 = (25.194830437829914 - 35.17940126769312) / 25.194830437829914 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.08758989641294 > 2.329390489190353. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.025715936920998 (T) = (0 -29.494070373162515) / Math.Sqrt((0.11312402893980343 / (33)) + (13.16717518702337 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.295977369113059 = (2.2182701996528738 - 29.494070373162515) / 2.2182701996528738 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.05375361741082 > 3.653605998357129. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.667563532000276 (T) = (0 -29.450749760768478) / Math.Sqrt((0.9034287147608874 / (33)) + (6.870116597003587 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.4850348600818855 = (3.4709049811121533 - 29.450749760768478) / 3.4709049811121533 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.68762615098503 > 3.615582785818652. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -68.65328461539438 (T) = (0 -54.08637850899367) / Math.Sqrt((0.8592150843780482 / (31)) + (2.060884468091843 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -14.45466204267469 = (3.499680443328097 - 54.08637850899367) / 3.499680443328097 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.524371763320378 > 2.5477259150084364. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.260608236493855 (T) = (0 -19.05976702645369) / Math.Sqrt((0.6064828594088332 / (33)) + (1.648594592010704 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.669517065642882 = (2.485132618302094 - 19.05976702645369) / 2.485132618302094 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.58528132834231 > 3.6607994681047975. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.897402941638486 (T) = (0 -23.91397755617664) / Math.Sqrt((1.480218460971244 / (32)) + (3.248334023614234 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.593748059284134 = (3.6267654361627093 - 23.91397755617664) / 3.6267654361627093 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.055233409400135 > 3.3247878626156853. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.062978577958454 (T) = (0 -21.185623590489797) / Math.Sqrt((1.0019115568099612 / (32)) + (2.295584174694832 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.531141616261329 = (3.2437856710596398 - 21.185623590489797) / 3.2437856710596398 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.49901247196446 > 4.825448947531956. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -82.9522904732737 (T) = (0 -40.08081803299115) / Math.Sqrt((2.65226936747648 / (32)) + (0.38778936721249274 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.17360248790969 = (4.90369064219581 - 40.08081803299115) / 4.90369064219581 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.049390049181106 > 3.542021983611576. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.34555390929341 (T) = (0 -53.500026645729754) / Math.Sqrt((1.57363385978392 / (33)) + (4.4499028975691655 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.940549412539164 = (3.5808607279748865 - 53.500026645729754) / 3.5808607279748865 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.69633902758164 > 3.5899280439145205. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -133.81525933503255 (T) = (0 -86.7366918548443) / Math.Sqrt((0.5954946511186338 / (31)) + (1.473071598107653 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -24.21566928632836 = (3.439793363005118 - 86.7366918548443) / 3.439793363005118 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.946115004073068 > 3.4018695673771573. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.082578316992546 (T) = (0 -25.15586090011445) / Math.Sqrt((0.21045371548357972 / (33)) + (3.535536307602938 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.450052914431573 = (3.3766016414977105 - 25.15586090011445) / 3.3766016414977105 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.491049861287564 > 2.2689297965024884. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.398810740194737 (T) = (0 -24.415052299690615) / Math.Sqrt((0.3892089974588018 / (33)) + (7.417102379004949 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.12511348427334 = (2.0135937145130822 - 24.415052299690615) / 2.0135937145130822 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.156366106450957 > 2.533427760409032. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.869156107321796 (T) = (0 -18.36319397479365) / Math.Sqrt((0.5814037413109061 / (33)) + (1.874924614704364 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.605292370545734 = (2.41452834159431 - 18.36319397479365) / 2.41452834159431 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.444507545570538 > 3.379498056233036. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.84805356104958 (T) = (0 -26.8237946620903) / Math.Sqrt((1.008410056775095 / (33)) + (3.377395588115783 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.488899909153115 = (3.5818070727992515 - 26.8237946620903) / 3.5818070727992515 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.467069611878546 > 3.4199500344017446. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.169607926801447 (T) = (0 -31.55080729309302) / Math.Sqrt((0.7415945276706571 / (33)) + (5.71549229528992 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.672660222201374 = (3.6379618807531817 - 31.55080729309302) / 3.6379618807531817 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.906478691282363 > 2.9693484389797162. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.58798527600483 (T) = (0 -24.52243393524835) / Math.Sqrt((0.9835706110951276 / (33)) + (2.9687975374461115 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.4024151410942505 = (2.9184982559734345 - 24.52243393524835) / 2.9184982559734345 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.099356482250133 > 2.555878539077264. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.904010803387344 (T) = (0 -20.414988581309817) / Math.Sqrt((0.617056282965503 / (32)) + (3.5677202922364337 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.615024566981233 = (2.369695921652302 - 20.414988581309817) / 2.369695921652302 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.74833439409311 > 3.5564309224666735. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.548649932239913 (T) = (0 -26.19278593996208) / Math.Sqrt((1.9166400169389994 / (32)) + (21.77126341351749 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.9042870636659 = (3.793698856729569 - 26.19278593996208) / 3.793698856729569 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.684590323311127 > 2.079931299253353. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.17523658454904 (T) = (0 -16.281199166639926) / Math.Sqrt((0.975975356191707 / (33)) + (0.2729438912748262 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.562949246727063 = (2.1527579566510733 - 16.281199166639926) / 2.1527579566510733 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.291505525541485 > 2.6795318833452573. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.940402248872868 (T) = (0 -20.525428709221025) / Math.Sqrt((1.3369740350877375 / (33)) + (2.7444070362122517 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.671747178367348 = (2.675456872079707 - 20.525428709221025) / 2.675456872079707 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.31022123845605 > 3.3137381859085195. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.677963874410347 (T) = (0 -24.624953075559006) / Math.Sqrt((2.057839687893518 / (33)) + (19.887641537324015 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.461211652709374 = (2.910334132543986 - 24.624953075559006) / 2.910334132543986 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.554260354796728 > 2.3920153937674744. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.62858932466054 (T) = (0 -26.048642732277706) / Math.Sqrt((0.6184002480088061 / (33)) + (3.89897740308554 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.431289921278776 = (2.4971641023169253 - 26.048642732277706) / 2.4971641023169253 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.827047767897575 > 2.644839363794788. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.458166912794603 (T) = (0 -27.95763031373393) / Math.Sqrt((0.5334485691898142 / (33)) + (6.12335020188939 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.129379236753234 = (2.512056577370257 - 27.95763031373393) / 2.512056577370257 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.191633877546046 > 3.52454272064528. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.8490740146293 (T) = (0 -34.16308643084526) / Math.Sqrt((2.673808457004559 / (32)) + (9.134141687565064 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.425395637251416 = (3.6245785053122415 - 34.16308643084526) / 3.6245785053122415 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.853421046374365 > 2.689966715968391. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.859288568792925 (T) = (0 -29.984036009080086) / Math.Sqrt((1.1657392658695533 / (33)) + (46.809621556402135 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -9.489142562737788 = (2.8585783661285182 - 29.984036009080086) / 2.8585783661285182 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.82345029929011 > 0.002542058416946569. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.46269526184984 (T) = (0 -14.345869417294706) / Math.Sqrt((0.31103264460555485 / (33)) + (1.0339918659720972 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -108.65957783578268 = (0.1308218552398398 - 14.345869417294706) / 0.1308218552398398 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.429532169785393 > 2.252246463827423. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.20546495204317 (T) = (0 -24.423032912638124) / Math.Sqrt((0.18469126619084564 / (33)) + (2.6178442077072575 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.526072951512056 = (2.320241653762222 - 24.423032912638124) / 2.320241653762222 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.766272135693924 > 3.4139064997739523. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -83.07665521268522 (T) = (0 -53.275945913692404) / Math.Sqrt((1.3669289747466566 / (32)) + (1.2591773191924929 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.78829120534204 = (3.6025761985568217 - 53.275945913692404) / 3.6025761985568217 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.177530733913844 > 16.604670718015996. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 2/9/2023 12:40:40 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.512393070318659 (T) = (0 -27.773940577390807) / Math.Sqrt((1.7005440014376132 / (32)) + (7.80305870514169 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7663578375588441 = (15.72384710890471 - 27.773940577390807) / 15.72384710890471 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.09686224540835 > 3.500818046004734. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.693929320549195 (T) = (0 -53.65391455519172) / Math.Sqrt((0.9903485754834669 / (33)) + (6.899074680390115 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.417320825729856 = (3.721489949744221 - 53.65391455519172) / 3.721489949744221 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.84199790301464 > 25.92796018076825. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 11:57:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.423542127866318 (T) = (0 -46.1911471234632) / Math.Sqrt((3.1513989142566623 / (32)) + (11.298844077075367 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.8513346395873903 = (24.950187899988677 - 46.1911471234632) / 24.950187899988677 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.63239060231695 > 3.4315671823701415. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.316941108540817 (T) = (0 -25.512666898559196) / Math.Sqrt((1.55365485781543 / (32)) + (4.967745214825299 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.149029280610533 = (3.5686896636098817 - 25.512666898559196) / 3.5686896636098817 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.20179728517396 > 2.6540080678919273. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.24518185141183 (T) = (0 -38.312325261420746) / Math.Sqrt((3.1625188618086844 / (32)) + (5.6656843228061335 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.811139878120484 = (3.543782218464955 - 38.312325261420746) / 3.543782218464955 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.02748561302361 > 3.473636326415939. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -61.15521833536189 (T) = (0 -51.825528033801426) / Math.Sqrt((1.0046256594279468 / (33)) + (2.3620484523886764 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.258241736920459 = (3.634776923412919 - 51.825528033801426) / 3.634776923412919 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.631812535219485 > 3.5920233803081394. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.923332025840766 (T) = (0 -32.887367047225155) / Math.Sqrt((0.6705647596935671 / (33)) + (24.101299830840073 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.211102256069964 = (3.5704051624823645 - 32.887367047225155) / 3.5704051624823645 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.40678043676457 > 3.365347465814999. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -172.83089690084222 (T) = (0 -52.082549958017324) / Math.Sqrt((0.851005477193229 / (32)) + (0.2097061708944891 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.885898034106898 = (3.4987845435112237 - 52.082549958017324) / 3.4987845435112237 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 180.00076213653298 > 4.013497503035639. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.856100825861006 (T) = (0 -185.54022573121517) / Math.Sqrt((0.6094772087724805 / (33)) + (62.77545959820058 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -48.186120383946964 = (3.772206961697482 - 185.54022573121517) / 3.772206961697482 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.61537011620917 > 3.510074021176175. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.242428846589334 (T) = (0 -33.68814162218112) / Math.Sqrt((0.6791578779017464 / (33)) + (1.984897958341192 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.145755255979994 = (3.320417334365034 - 33.68814162218112) / 3.320417334365034 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanOrEqualAnyBenchmark.html>)	2.54 ns	22.64 ns	8.92	0.71	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseOrBenchmark.html>)	3.30 ns	53.59 ns	16.22	0.60	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).SubtractBenchmark.html>)	3.24 ns	61.31 ns	18.93	0.50	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).CountBenchmark.html>)	0.04 ns	14.87 ns	422.14	0.89	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanAllBenchmark.html>)	2.50 ns	25.64 ns	10.24	0.68	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).ZeroBenchmark.html>)	1.98 ns	16.53 ns	8.36	0.66	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementOperatorBenchmark.html>)	4.45 ns	44.92 ns	10.10	0.68	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).AndNotBenchmark.html>)	4.14 ns	85.65 ns	20.71	0.58	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).MaxBenchmark.html>)	3.19 ns	67.63 ns	21.22	0.49	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanBenchmark.html>)	3.44 ns	64.13 ns	18.62	0.51	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).AddBenchmark.html>)	3.43 ns	72.77 ns	21.20	0.51	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanAllBenchmark.html>)	2.67 ns	57.37 ns	21.52	0.61	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseOrOperatorBenchmark.html>)	3.50 ns	52.89 ns	15.11	0.59	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseAndBenchmark.html>)	3.09 ns	58.45 ns	18.90	0.65	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanOrEqualBenchmark.html>)	3.31 ns	73.56 ns	22.24	0.53	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsStaticBenchmark.html>)	3.18 ns	65.05 ns	20.44	0.52	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementBenchmark.html>)	3.16 ns	40.14 ns	12.69	0.64	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualityOperatorBenchmark.html>)	2.38 ns	17.81 ns	7.49	0.69	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsAllBenchmark.html>)	3.20 ns	26.11 ns	8.15	0.69	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).InequalityOperatorBenchmark.html>)	1.84 ns	15.87 ns	8.64	0.71	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseAndOperatorBenchmark.html>)	3.32 ns	52.30 ns	15.76	0.61	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).GreaterThanOrEqualAllBenchmark.html>)	4.72 ns	19.07 ns	4.04	0.63	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).ExclusiveOrOperatorBenchmark.html>)	3.34 ns	53.01 ns	15.88	0.64	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).ConditionalSelectBenchmark.html>)	3.39 ns	178.59 ns	52.63	0.60	True
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).AbsBenchmark.html>)	4.27 ns	15.45 ns	3.62	0.63	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).XorBenchmark.html>)	2.97 ns	52.47 ns	17.65	0.62	True
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).LessThanAnyBenchmark.html>)	5.41 ns	18.84 ns	3.49	0.73	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt16&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.639551974668283 > 2.5847492880967446. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.11701237962044 (T) = (0 -20.856859228063126) / Math.Sqrt((0.38946997056414323 / (33)) + (5.141365831218578 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.339949998092113 = (2.500837443010383 - 20.856859228063126) / 2.500837443010383 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.591026800517774 > 3.76454957935153. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -112.94686355745065 (T) = (0 -53.70015187513693) / Math.Sqrt((0.8907108027628626 / (33)) + (0.6831229126946347 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.47144742879197 = (3.4709197133813294 - 53.70015187513693) / 3.4709197133813294 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.31443395021686 > 3.412963493474682. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.68722625619716 (T) = (0 -64.62869446702138) / Math.Sqrt((0.2861541516089562 / (33)) + (14.04120336385899 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.519528671529667 = (3.3109761795266075 - 64.62869446702138) / 3.3109761795266075 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.868531777840989 > 0.0906469916408637. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -3.6589843505531707 (T) = (0 -19.528469242611703) / Math.Sqrt((0.03328730016878351 / (33)) + (112.81033081708715 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -200.9877706079137 = (0.09668144355392275 - 19.528469242611703) / 0.09668144355392275 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.636703993692816 > 2.6211370207005062. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.713946656471704 (T) = (0 -22.361596409982337) / Math.Sqrt((0.27644844420069814 / (32)) + (8.305287091278878 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.736740919570036 = (2.55948947277274 - 22.361596409982337) / 2.55948947277274 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.53442765688026 > 2.0543632478260485. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.96975747877705 (T) = (0 -16.137334157050716) / Math.Sqrt((0.19683042738953765 / (32)) + (0.3174918057932213 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.65225855204594 = (2.10883284291749 - 16.137334157050716) / 2.10883284291749 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.92222095583783 > 4.626174606535201. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.986864948499402 (T) = (0 -41.87381438580215) / Math.Sqrt((0.7966941613937982 / (33)) + (5.694636373772679 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.124847459096696 = (4.588987878811883 - 41.87381438580215) / 4.588987878811883 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.64829863197656 > 3.538497433173961. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -577.8260019130067 (T) = (0 -85.4329908680022) / Math.Sqrt((0.3120561221328316 / (32)) + (0.04141260947754837 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -23.39535328232214 = (3.5020190066241175 - 85.4329908680022) / 3.5020190066241175 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 67.63404631980703 > 3.60772020455164. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.520475637596554 (T) = (0 -71.87241562381783) / Math.Sqrt((0.9690216462903065 / (33)) + (54.24339526955612 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.982011619526872 = (3.5968558617783253 - 71.87241562381783) / 3.5968558617783253 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.13401103901576 > 3.6002784372508514. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.452322561817038 (T) = (0 -67.5352949559177) / Math.Sqrt((2.1091437699944033 / (31)) + (19.78900948244998 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -16.694360385339415 = (3.8167694952044595 - 67.5352949559177) / 3.8167694952044595 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 72.76630864890525 > 3.501016549581375. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.444499662947365 (T) = (0 -68.93342815588416) / Math.Sqrt((3.6591107483079637 / (33)) + (14.744137537746857 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.311187720092434 = (3.7645525352921334 - 68.93342815588416) / 3.7645525352921334 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.37499709155761 > 2.7289766749388646. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.63709814317425 (T) = (0 -63.4607623970623) / Math.Sqrt((0.4961765618397499 / (33)) + (53.48880186889096 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -23.52119975339611 = (2.5879958173038893 - 63.4607623970623) / 2.5879958173038893 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.88758058152239 > 3.4880080296250506. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -258.5355627820017 (T) = (0 -52.46732058078369) / Math.Sqrt((0.38700457947680383 / (32)) + (0.09438506221674019 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.47295347071544 = (3.625197903589341 - 52.46732058078369) / 3.625197903589341 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.45129890986884 > 3.342576648304522. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.06139253703969 (T) = (0 -53.940928548608) / Math.Sqrt((1.6449172029888155 / (33)) + (9.147484187729692 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.854661163179939 = (3.4022126359835223 - 53.940928548608) / 3.4022126359835223 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 73.56077281399435 > 3.414680971042864. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.561313109684754 (T) = (0 -69.26460377581871) / Math.Sqrt((2.025474473415843 / (33)) + (11.921227248473812 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.440706433307255 = (3.756071060852327 - 69.26460377581871) / 3.756071060852327 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.05286711060458 > 3.624857894474315. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -80.03803532462659 (T) = (0 -64.54922165348285) / Math.Sqrt((0.5742049879323583 / (33)) + (2.260414309630961 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.64158383057728 = (3.4626468566262343 - 64.54922165348285) / 3.4626468566262343 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.13885069749349 > 3.328738861348508. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -103.07815051744673 (T) = (0 -39.63256766874567) / Math.Sqrt((0.3848294057901113 / (33)) + (0.45126372523863895 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.137885221137083 = (3.2651954559373295 - 39.63256766874567) / 3.2651954559373295 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.807693559581008 > 2.3820003726632257. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.65064318892747 (T) = (0 -19.020615342378722) / Math.Sqrt((0.5575715938807304 / (33)) + (2.4904532225211464 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.588716360003961 = (2.5064338209589896 - 19.020615342378722) / 2.5064338209589896 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.10670873887903 > 2.34047338018274. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.218049878395604 (T) = (0 -27.314006887556076) / Math.Sqrt((0.520592361602425 / (32)) + (7.39794347252236 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.242667218337292 = (2.429495275196415 - 27.314006887556076) / 2.429495275196415 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.871459149551018 > 2.518663324759012. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.09978048949122 (T) = (0 -17.12273553315865) / Math.Sqrt((0.322647652769495 / (33)) + (1.5413398337065096 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.578867055088839 = (2.602687573677901 - 17.12273553315865) / 2.602687573677901 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.3007107681467 > 3.4645439429768867. IsChangePoint: Marked as a change because one of 3/1/2023 11:57:24 AM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -89.48312671822418 (T) = (0 -53.24345212319767) / Math.Sqrt((1.040436895429198 / (32)) + (1.0902941149782184 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.946408936232354 = (3.817717691102028 - 53.24345212319767) / 3.817717691102028 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.06941188391166 > 2.82456655499348. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.652975728488315 (T) = (0 -22.321281583493864) / Math.Sqrt((0.46533578866623865 / (33)) + (9.797302235722123 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.066145314971127 = (2.4620476297279543 - 22.321281583493864) / 2.4620476297279543 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.008363097530626 > 3.5520976761786884. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -100.22386156045023 (T) = (0 -53.259066496361584) / Math.Sqrt((0.7886491159687098 / (33)) + (0.8889368907141209 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.060913677953767 = (3.5362440576445535 - 53.259066496361584) / 3.5362440576445535 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 178.59284931967053 > 3.65294572351652. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -181.57431313186316 (T) = (0 -177.56286153042777) / Math.Sqrt((2.026649642216077 / (32)) + (3.4050548104582035 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -44.35328994469583 = (3.9151043231251657 - 177.56286153042777) / 3.9151043231251657 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.44769081565904 > 4.533492988952289. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.907610025400697 (T) = (0 -15.104334212551407) / Math.Sqrt((0.6886978790600152 / (33)) + (0.5851215795105021 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -2.3473909966101356 = (4.512270669260745 - 15.104334212551407) / 4.512270669260745 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.46528729149226 > 3.431786330647929. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -308.82532770515036 (T) = (0 -52.43103078320594) / Math.Sqrt((0.7950676869588489 / (33)) + (0.00566177738872324 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.872662897828482 = (3.1074544131355717 - 52.43103078320594) / 3.1074544131355717 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.841967497272325 > 2.772224351345854. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.429030448172032 (T) = (0 -19.688008568908245) / Math.Sqrt((1.1907192131187323 / (32)) + (2.7150115611004506 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -6.107456891303114 = (2.7700496633330345 - 19.688008568908245) / 2.7700496633330345 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).ExclusiveOrOperatorBenchmark.html>)	2.58 ns	49.72 ns	19.26	0.61	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).SubtractBenchmark.html>)	3.24 ns	54.72 ns	16.89	0.55	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanAllBenchmark.html>)	2.46 ns	26.78 ns	10.87	0.69	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).CountBenchmark.html>)	0.02 ns	14.78 ns	723.81	0.91	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanOrEqualAllBenchmark.html>)	1.34 ns	28.08 ns	20.90	0.68	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).BitwiseOrOperatorBenchmark.html>)	3.24 ns	46.25 ns	14.26	0.61	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanAllBenchmark.html>)	4.58 ns	70.79 ns	15.46	0.56	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).EqualsAnyBenchmark.html>)	2.42 ns	62.85 ns	25.98	0.54	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).AddBenchmark.html>)	3.69 ns	63.42 ns	17.20	0.43	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanAnyBenchmark.html>)	2.43 ns	71.98 ns	29.65	0.59	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).EqualsAllBenchmark.html>)	2.41 ns	28.94 ns	12.02	0.64	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).ZeroBenchmark.html>)	2.04 ns	16.56 ns	8.13	0.63	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).DotBenchmark.html>)	2.75 ns	115.87 ns	42.06	0.55	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).AndNotBenchmark.html>)	3.24 ns	48.70 ns	15.04	0.68	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).OnesComplementBenchmark.html>)	3.16 ns	42.47 ns	13.45	0.64	True
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).InequalityOperatorBenchmark.html>)	2.07 ns	17.29 ns	8.37	0.66	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).AllBitsSetBenchmark.html>)	1.99 ns	30.51 ns	15.36	0.62	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanOrEqualAnyBenchmark.html>)	2.48 ns	65.17 ns	26.33	0.55	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).SubtractionOperatorBenchmark.html>)	3.20 ns	47.80 ns	14.95	0.56	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanBenchmark.html>)	3.35 ns	109.67 ns	32.69	0.53	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).ConditionalSelectBenchmark.html>)	3.55 ns	53.93 ns	15.20	0.67	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanBenchmark.html>)	3.36 ns	81.26 ns	24.21	0.52	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).LessThanOrEqualBenchmark.html>)	3.69 ns	81.78 ns	22.17	0.45	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).OnesComplementOperatorBenchmark.html>)	5.67 ns	44.53 ns	7.85	0.57	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).EqualityOperatorBenchmark.html>)	2.49 ns	17.09 ns	6.86	0.69	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).SquareRootBenchmark.html>)	45.29 ns	84.51 ns	1.87	0.53	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).BitwiseAndBenchmark.html>)	2.14 ns	48.54 ns	22.63	0.60	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).MinBenchmark.html>)	3.32 ns	74.27 ns	22.39	0.50	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).DivideBenchmark.html>)	41.63 ns	68.31 ns	1.64	0.40	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).XorBenchmark.html>)	3.68 ns	47.71 ns	12.95	0.59	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).MaxBenchmark.html>)	3.10 ns	74.72 ns	24.11	0.47	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).MultiplyBenchmark.html>)	5.40 ns	54.54 ns	10.10	0.54	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).BitwiseAndOperatorBenchmark.html>)	4.82 ns	48.65 ns	10.09	0.58	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).SumBenchmark.html>)	2.70 ns	59.72 ns	22.14	0.55	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).EqualsStaticBenchmark.html>)	4.29 ns	88.81 ns	20.69	0.50	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanOrEqualAnyBenchmark.html>)	2.39 ns	30.07 ns	12.57	0.67	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).BitwiseOrBenchmark.html>)	3.59 ns	52.97 ns	14.77	0.59	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanAnyBenchmark.html>)	2.57 ns	30.18 ns	11.73	0.64	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanOrEqualAllBenchmark.html>)	2.33 ns	75.52 ns	32.46	0.56	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).AbsBenchmark.html>)	3.83 ns	70.70 ns	18.45	0.54	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int16).GreaterThanOrEqualBenchmark.html>)	3.32 ns	109.25 ns	32.88	0.47	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.72298036214196 > 3.617187732094393. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -87.92338823154421 (T) = (0 -48.780289951611515) / Math.Sqrt((0.870688159918484 / (33)) + (0.9579303028817643 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.15985986021303 = (3.444969825490747 - 48.780289951611515) / 3.444969825490747 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.72006316145795 > 3.432014515629538. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.997801710427236 (T) = (0 -54.57039578315548) / Math.Sqrt((1.1523596332142336 / (33)) + (19.495707365466558 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.088633604706903 = (3.616655902237048 - 54.57039578315548) / 3.616655902237048 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.775323030781866 > 2.5240360793857444. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.042985490788848 (T) = (0 -30.47565683042097) / Math.Sqrt((1.2139980284438876 / (33)) + (37.815436404067135 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.645141256081937 = (2.617027665036212 - 30.47565683042097) / 2.617027665036212 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.781216712766017 > 0.019694707743521698. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -146.38301057205115 (T) = (0 -14.750455488555579) / Math.Sqrt((0.27030633854226016 / (32)) + (0.003872206208975962 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -47.309722532733 = (0.30533099167690686 - 14.750455488555579) / 0.30533099167690686 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.078359565208057 > 2.558719761991991. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -64.56049091890623 (T) = (0 -27.669008959464044) / Math.Sqrt((0.7609793997728868 / (32)) + (0.5097888084369283 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.796766810870217 = (2.562712471626858 - 27.669008959464044) / 2.562712471626858 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.24724636557921 > 3.447433527197285. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.00969055550584 (T) = (0 -49.20462005605663) / Math.Sqrt((0.5296048771481442 / (32)) + (5.459267981196329 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.662054610379018 = (3.3559157542098856 - 49.20462005605663) / 3.3559157542098856 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 70.79298286889501 > 2.3538697116524703. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -71.56529485486602 (T) = (0 -69.65893602490179) / Math.Sqrt((0.6605132326509768 / (33)) + (3.4479190018608565 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -27.44763793018855 = (2.4486720548063476 - 69.65893602490179) / 2.4486720548063476 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.85310954427795 > 2.537091730772748. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.77479617240599 (T) = (0 -65.05518936195206) / Math.Sqrt((1.345391464671047 / (32)) + (9.651494637411373 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -22.783202641134213 = (2.7353418437193957 - 65.05518936195206) / 2.7353418437193957 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.4203565954402 > 3.577331697674034. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.48613720462178 (T) = (0 -56.87187507171933) / Math.Sqrt((1.278131942873338 / (32)) + (24.610423569252806 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.707423067389293 = (3.40398844527531 - 56.87187507171933) / 3.40398844527531 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.97734571576582 > 2.767201082677744. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.87526338890269 (T) = (0 -69.45073372639654) / Math.Sqrt((1.2895976491937258 / (32)) + (14.512557133540817 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -25.172773436807923 = (2.6535488833111174 - 69.45073372639654) / 2.6535488833111174 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.944124329211757 > 2.462228232145213. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.904733891927563 (T) = (0 -28.70315324303858) / Math.Sqrt((1.9753579557938914 / (33)) + (27.97160150983729 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.964037311740327 = (2.3991193353160254 - 28.70315324303858) / 2.3991193353160254 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.55526221707209 > 1.9497977985023776. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -122.0820404439377 (T) = (0 -16.509750306996594) / Math.Sqrt((0.34629278853970813 / (32)) + (0.014292771808496751 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.864156814601941 = (1.8625291330361005 - 16.509750306996594) / 1.8625291330361005 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 115.8664417028709 > 3.0276050794597786. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.422094350550964 (T) = (0 -108.43426243935531) / Math.Sqrt((0.19185302541115182 / (32)) + (39.77420107911086 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -35.00932301646519 = (3.011283005508711 - 108.43426243935531) / 3.011283005508711 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.701192675103336 > 3.427175262078451. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -116.61484426947085 (T) = (0 -49.00022431323003) / Math.Sqrt((3.1713185520752334 / (33)) + (0.22469269942108164 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.022228445237262 = (3.494467694959945 - 49.00022431323003) / 3.494467694959945 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.47205761515447 > 3.4003129035408493. IsChangePoint: Marked as a change because one of 3/1/2023 11:57:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.704095890083998 (T) = (0 -44.856993450660624) / Math.Sqrt((0.5372177371881405 / (33)) + (10.358352494405437 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.335832473192431 = (3.3636440425321585 - 44.856993450660624) / 3.3636440425321585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.292669539352197 > 2.4621115094033894. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.474925203875058 (T) = (0 -19.27969104492837) / Math.Sqrt((2.487907350914357 / (33)) + (4.147709400044684 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.515990341873641 = (2.958827443471101 - 19.27969104492837) / 2.958827443471101 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.5106659639207 > 2.113254090133085. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.07778697224835 (T) = (0 -30.59691077560163) / Math.Sqrt((0.4272761795746821 / (32)) + (1.9801913457305458 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.142702684555635 = (2.0205713215784176 - 30.59691077560163) / 2.0205713215784176 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.17058331862451 > 2.56744566941632. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -49.70011611854898 (T) = (0 -66.82251636945898) / Math.Sqrt((0.4971081796990979 / (33)) + (6.651924257110861 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -26.37172822693141 = (2.4412969402389217 - 66.82251636945898) / 2.4412969402389217 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.80376445147871 > 3.419029932129058. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.748422777538295 (T) = (0 -49.16775223636403) / Math.Sqrt((1.128032639667035 / (33)) + (33.39683084440364 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.773889055375436 = (3.569634693490993 - 49.16775223636403) / 3.569634693490993 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 109.66569512741587 > 3.5046318369414573. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -116.12235195325609 (T) = (0 -112.12764531210524) / Math.Sqrt((0.9107533398446083 / (32)) + (3.4014974588441533 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -33.317842679178575 = (3.2673279133637285 - 112.12764531210524) / 3.2673279133637285 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.931582458235944 > 3.7901401581817806. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.391998437533914 (T) = (0 -53.438372225011925) / Math.Sqrt((0.30490909344339234 / (32)) + (3.602391279322598 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.461933449908072 = (3.4561248370480886 - 53.438372225011925) / 3.4561248370480886 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 81.26486414174447 > 3.423801421039751. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -96.61613455392897 (T) = (0 -82.97050555215513) / Math.Sqrt((0.1925481486600915 / (33)) + (2.7006373291205894 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.603571338992868 = (3.240583294167072 - 82.97050555215513) / 3.240583294167072 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 81.77691426267404 > 3.616804694715471. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.88938238220971 (T) = (0 -83.94182396212945) / Math.Sqrt((0.8487791977935543 / (33)) + (7.934060101627092 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.417337117842088 = (3.302542023696306 - 83.94182396212945) / 3.302542023696306 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.52967996622714 > 6.051533230109708. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -83.8202997823295 (T) = (0 -43.44105112106526) / Math.Sqrt((0.7785101802353599 / (33)) + (0.7002374447897178 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.142387455518984 = (6.0821470959963095 - 43.44105112106526) / 6.0821470959963095 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.085275705082868 > 2.592256838866393. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.052802006965589 (T) = (0 -19.42587885217008) / Math.Sqrt((1.0319307094495334 / (33)) + (4.854802468382748 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.385644085800733 = (2.630221362753899 - 19.42587885217008) / 2.630221362753899 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 84.5084244619099 > 48.1271083598643. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.187563113089399 (T) = (0 -72.95440496567691) / Math.Sqrt((4.9450315854863005 / (33)) + (60.42720150272754 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.6255454217244503 = (44.8799547466866 - 72.95440496567691) / 44.8799547466866 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.54302591189463 > 3.5159651946413826. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -120.23140973120186 (T) = (0 -48.90500678725584) / Math.Sqrt((0.2917656253985169 / (33)) + (0.5404348400056775 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.872421223750672 = (3.2883016189157197 - 48.90500678725584) / 3.2883016189157197 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 74.26688125065844 > 3.523437655998357. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -94.30291124326513 (T) = (0 -75.73647938966191) / Math.Sqrt((0.6586192480204162 / (33)) + (2.288100799677531 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -22.821068201860655 = (3.1793905608207003 - 75.73647938966191) / 3.1793905608207003 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.3118198377174 > 45.3470412686256. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.02995026727715 (T) = (0 -63.84766617278035) / Math.Sqrt((8.557297093599852 / (31)) + (11.915062089440875 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.45278573953844314 = (43.94843949463949 - 63.84766617278035) / 43.94843949463949 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.70973526034957 > 3.555522217494719. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.081362761789606 (T) = (0 -49.310497346756726) / Math.Sqrt((0.6050671015419938 / (32)) + (5.399202520682166 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.741281388199358 = (3.588493383819594 - 49.310497346756726) / 3.588493383819594 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 74.71710386354745 > 3.4521280345409386. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -113.63983331917225 (T) = (0 -76.64229794410379) / Math.Sqrt((0.12471944555715725 / (33)) + (1.6551101556737613 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -22.877752638280832 = (3.209778537584429 - 76.64229794410379) / 3.209778537584429 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.54336728393676 > 3.419955587828468. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.212961490200904 (T) = (0 -54.04634626317523) / Math.Sqrt((0.5035621470978936 / (33)) + (5.227882102161669 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.854555676109635 = (3.2066313287500554 - 54.04634626317523) / 3.2066313287500554 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.650516901254186 > 3.485158258245375. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -55.55586466849048 (T) = (0 -50.15727548080143) / Math.Sqrt((1.1440454473660038 / (33)) + (2.662408742259298 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.678262450258902 = (3.6669332572904425 - 50.15727548080143) / 3.6669332572904425 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.71752693619258 > 2.8108631806253146. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.45479037137535 (T) = (0 -55.72363578590572) / Math.Sqrt((0.7288572345352565 / (32)) + (16.10161989614512 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -21.322050773631375 = (2.4963492983239255 - 55.72363578590572) / 2.4963492983239255 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 88.80649900137901 > 3.5779496645264586. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.3964331496544 (T) = (0 -83.74113173635907) / Math.Sqrt((0.20242175443338362 / (31)) + (20.639319309100063 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -24.481435410388322 = (3.2863584954173857 - 83.74113173635907) / 3.2863584954173857 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.07317525279971 > 2.528712514246771. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.11964524776723 (T) = (0 -29.6857711067054) / Math.Sqrt((0.8627041180583003 / (32)) + (9.957773966357204 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.740098364814571 = (2.52857941937476 - 29.6857711067054) / 2.52857941937476 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.97014379432068 > 3.7122696736451224. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.93116197157006 (T) = (0 -50.98756594649745) / Math.Sqrt((0.5994955859486948 / (32)) + (6.520552755456318 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.302898074238286 = (3.56484159237168 - 50.98756594649745) / 3.56484159237168 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.1769703952382 > 2.6166488039018665. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.861803809712 (T) = (0 -30.759830441140192) / Math.Sqrt((1.2044247502913814 / (33)) + (9.668329577675362 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.059652997498862 = (2.7812654201805898 - 30.759830441140192) / 2.7812654201805898 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 75.52493508866863 > 2.495368613701759. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.518910565618157 (T) = (0 -67.66647201339524) / Math.Sqrt((0.3742902349423728 / (32)) + (28.25739621962477 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -26.685456907457265 = (2.44411613792687 - 67.66647201339524) / 2.44411613792687 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 70.7005174185381 > 3.504403410248739. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.004036883619417 (T) = (0 -68.81614434143516) / Math.Sqrt((0.912937280316929 / (32)) + (59.377886139767334 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -20.24495793245708 = (3.239175363877798 - 68.81614434143516) / 3.239175363877798 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 109.24606378936579 > 3.4491550607503414. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.11826360388487 (T) = (0 -112.16709587386975) / Math.Sqrt((1.7240396141746155 / (32)) + (11.93481947984968 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -31.080080506454372 = (3.496471770116108 - 112.16709587386975) / 3.496471770116108 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).ExclusiveOrOperatorBenchmark.html>)	3.20 ns	50.64 ns	15.82	0.59	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).EqualityOperatorBenchmark.html>)	2.10 ns	17.16 ns	8.17	0.73	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).InequalityOperatorBenchmark.html>)	2.66 ns	21.84 ns	8.23	0.73	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanOrEqualBenchmark.html>)	3.40 ns	70.43 ns	20.74	0.61	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanBenchmark.html>)	2.45 ns	58.66 ns	23.93	0.51	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).SquareRootBenchmark.html>)	57.33 ns	74.64 ns	1.30	0.50	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).MultiplyBenchmark.html>)	3.31 ns	44.02 ns	13.32	0.60	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).AbsBenchmark.html>)	6.20 ns	34.63 ns	5.58	0.64	True
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanAllBenchmark.html>)	2.28 ns	28.97 ns	12.68	0.68	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).ConditionalSelectBenchmark.html>)	3.45 ns	51.81 ns	15.01	0.63	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanOrEqualAllBenchmark.html>)	2.46 ns	27.66 ns	11.22	0.73	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).MaxBenchmark.html>)	3.29 ns	59.80 ns	18.18	0.54	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).EqualsStaticBenchmark.html>)	4.97 ns	52.25 ns	10.51	0.55	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanOrEqualBenchmark.html>)	3.23 ns	55.52 ns	17.16	0.54	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).OnesComplementBenchmark.html>)	3.20 ns	41.98 ns	13.10	0.59	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanAnyBenchmark.html>)	2.16 ns	30.92 ns	14.34	0.73	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanAnyBenchmark.html>)	2.46 ns	52.71 ns	21.39	0.67	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).AndNotBenchmark.html>)	2.01 ns	48.41 ns	24.05	0.64	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).DotBenchmark.html>)	2.89 ns	68.29 ns	23.59	0.61	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).BitwiseOrBenchmark.html>)	3.14 ns	48.23 ns	15.36	0.59	True
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).EqualsAllBenchmark.html>)	1.32 ns	28.86 ns	21.81	0.69	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).AllBitsSetBenchmark.html>)	1.94 ns	31.62 ns	16.32	0.60	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).SubtractBenchmark.html>)	5.93 ns	37.36 ns	6.30	0.56	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanOrEqualAnyBenchmark.html>)	2.10 ns	26.61 ns	12.65	0.74	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).BitwiseOrOperatorBenchmark.html>)	3.24 ns	48.21 ns	14.89	0.59	True
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).XorBenchmark.html>)	3.35 ns	47.99 ns	14.33	0.59	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).SumBenchmark.html>)	2.53 ns	39.28 ns	15.53	0.66	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).AddBenchmark.html>)	4.91 ns	43.15 ns	8.79	0.60	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).BitwiseAndBenchmark.html>)	3.24 ns	50.60 ns	15.62	0.64	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).ZeroBenchmark.html>)	2.01 ns	16.36 ns	8.15	0.69	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanAllBenchmark.html>)	2.52 ns	45.96 ns	18.26	0.63	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanBenchmark.html>)	3.57 ns	65.86 ns	18.44	0.60	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).BitwiseAndOperatorBenchmark.html>)	3.70 ns	50.24 ns	13.56	0.59	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).OnesComplementOperatorBenchmark.html>)	8.57 ns	46.08 ns	5.37	0.59	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).MinBenchmark.html>)	3.60 ns	62.98 ns	17.48	0.59	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).LessThanOrEqualAnyBenchmark.html>)	2.22 ns	53.12 ns	23.89	0.59	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).GreaterThanOrEqualAllBenchmark.html>)	2.47 ns	49.33 ns	20.01	0.64	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).EqualsAnyBenchmark.html>)	2.54 ns	49.74 ns	19.59	0.66	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt32).CountBenchmark.html>)	0.02 ns	14.63 ns	696.94	0.91	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.64243937486724 > 3.4016938659417826. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -102.58255820524758 (T) = (0 -49.480508858477464) / Math.Sqrt((1.4279711197980682 / (33)) + (0.6418988263170405 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.57709162593908 = (3.1764921236055508 - 49.480508858477464) / 3.1764921236055508 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.15908100647067 > 2.343688904092044. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.912864260856944 (T) = (0 -20.27708631983079) / Math.Sqrt((0.5599431263025846 / (32)) + (7.6240276681328565 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.562337215222462 = (2.368171891639748 - 20.27708631983079) / 2.368171891639748 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.842634648734663 > 2.6895258375938114. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.696598408955182 (T) = (0 -19.88965641081307) / Math.Sqrt((0.10554266337718898 / (33)) + (5.511374843267519 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.595687868992366 = (2.6185457793767406 - 19.88965641081307) / 2.6185457793767406 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 70.43341402661167 > 3.4075888183495824. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -77.22199710453759 (T) = (0 -68.54706750628121) / Math.Sqrt((0.8381579027194018 / (33)) + (2.750786263164096 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.54167551814254 = (3.3369754792270965 - 68.54706750628121) / 3.3369754792270965 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.66373097305596 > 2.974739689291344. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.13896236231429 (T) = (0 -54.832472928748274) / Math.Sqrt((1.3739782306039152 / (32)) + (9.001165868084888 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -16.493508981395262 = (3.1344467817785344 - 54.832472928748274) / 3.1344467817785344 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 74.6424435479937 > 58.12859162648227. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.65667304409321 (T) = (0 -72.56853976460695) / Math.Sqrt((11.992469986952738 / (32)) + (10.560554072412275 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.3422498940061902 = (54.0648504340819 - 72.56853976460695) / 54.0648504340819 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.01705605142498 > 3.4172097257195975. IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.960545060208332 (T) = (0 -40.326799191863714) / Math.Sqrt((0.4600536974706518 / (33)) + (8.721496612218194 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.029978662121028 = (3.352192079844772 - 40.326799191863714) / 3.352192079844772 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.63114859519669 > 5.990872095115217. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -76.09443705440457 (T) = (0 -34.68345564800393) / Math.Sqrt((0.9164444689463105 / (33)) + (0.45734605268806994 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -4.782487111128722 = (5.998016940021131 - 34.68345564800393) / 5.998016940021131 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.968167505106283 > 2.7054319267004834. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.164158635686057 (T) = (0 -28.78636874697017) / Math.Sqrt((0.3533609204040603 / (31)) + (8.323684013933322 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.458719838052378 = (2.5121801696709385 - 28.78636874697017) / 2.5121801696709385 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.8099084470641 > 3.714969036587185. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -62.771125042511834 (T) = (0 -52.88114935751213) / Math.Sqrt((0.9857950064482737 / (33)) + (2.338320458601031 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.382669511917104 = (3.6767270021532643 - 52.88114935751213) / 3.6767270021532643 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.65782254395237 > 2.586323375162078. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.43566562573972 (T) = (0 -29.186949014534996) / Math.Sqrt((0.24832453334712376 / (33)) + (4.0740398106338445 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.113938692017088 = (2.4093690546550954 - 29.186949014534996) / 2.4093690546550954 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.79501215290461 > 3.447789866252775. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.55978665016757 (T) = (0 -58.464262208600225) / Math.Sqrt((0.356952927457687 / (32)) + (17.0707131554338 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.588244084162305 = (3.524439471228858 - 58.464262208600225) / 3.524439471228858 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.254607955693984 > 3.7681539419521433. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.47648108750077 (T) = (0 -54.636040675094165) / Math.Sqrt((1.4409658022588654 / (33)) + (6.8145663491361015 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.470761839822172 = (3.775616051170225 - 54.636040675094165) / 3.775616051170225 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.51704177272163 > 3.372052696237531. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -62.29047570550487 (T) = (0 -53.137464989010084) / Math.Sqrt((0.12857866470967802 / (32)) + (2.5402994634893923 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.907468710262059 = (3.3404098387275534 - 53.137464989010084) / 3.3404098387275534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.97707268179645 > 3.330030835817917. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -67.35929854654249 (T) = (0 -42.945372823022495) / Math.Sqrt((0.24402916722425755 / (32)) + (1.3537283219271894 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.934868479643173 = (3.320124428834332 - 42.945372823022495) / 3.320124428834332 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.91614711199399 > 2.5145273881066728. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.50261378089186 (T) = (0 -31.205756676494747) / Math.Sqrt((0.5948482542286874 / (32)) + (10.820665413277652 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.451995164576577 = (2.3197864922423945 - 31.205756676494747) / 2.3197864922423945 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.71398125436895 > 2.560236551565487. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.595713322194296 (T) = (0 -52.54876331565644) / Math.Sqrt((1.2996131711453398 / (32)) + (21.059732522345932 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.72934208077321 = (2.8056918971863345 - 52.54876331565644) / 2.8056918971863345 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.4077779736163 > 3.277107654574713. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -262.28778942674705 (T) = (0 -48.18378473113743) / Math.Sqrt((0.4484103517169326 / (33)) + (0.04766664550829987 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -14.28728765364022 = (3.1518857905224196 - 48.18378473113743) / 3.1518857905224196 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.29354876009131 > 2.9119391962076557. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -58.88975231319759 (T) = (0 -67.20036006569977) / Math.Sqrt((0.3628423373271979 / (33)) + (4.73111483690326 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -22.517688299435076 = (2.8574390139916095 - 67.20036006569977) / 2.8574390139916095 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.23156581019181 > 3.401247312754441. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -99.38388554572546 (T) = (0 -48.14700682690635) / Math.Sqrt((1.4862421455133745 / (33)) + (0.6328577559541628 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.409724477543648 = (3.3412857339458113 - 48.14700682690635) / 3.3412857339458113 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.864953606847873 > 2.387434354397861. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.97582104508347 (T) = (0 -27.873422649978043) / Math.Sqrt((0.7592080653512686 / (32)) + (4.8158461816194205 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.53712459174829 = (2.415976565765267 - 27.873422649978043) / 2.415976565765267 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.618761611321773 > 2.123384783638651. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.65563373704741 (T) = (0 -30.782320919683983) / Math.Sqrt((2.138894289089173 / (33)) + (2.013007610343731 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.819610348488963 = (2.401190058269772 - 30.782320919683983) / 2.401190058269772 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.361486518432635 > 3.4294106155763835. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.182238107930246 (T) = (0 -42.200893061179784) / Math.Sqrt((0.9473802343697113 / (33)) + (14.666441444397357 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.396901025190582 = (3.4041485832166685 - 42.200893061179784) / 3.4041485832166685 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.614352667868545 > 2.4093525524633845. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.022542443851957 (T) = (0 -27.184103729833865) / Math.Sqrt((1.0213318494019794 / (32)) + (4.479566311378966 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.980036606291874 = (2.4757753279489614 - 27.184103729833865) / 2.4757753279489614 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.211865247862804 > 3.571497481957533. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -74.71560397926147 (T) = (0 -48.90532288151253) / Math.Sqrt((0.4040844756065883 / (33)) + (1.4442667394235984 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.026249227457376 = (3.2546593724898507 - 48.90532288151253) / 3.2546593724898507 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.98608405817014 > 3.48071411565028. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -146.22231241574636 (T) = (0 -48.65315622059667) / Math.Sqrt((1.0085352308105149 / (33)) + (0.25717686171278525 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.445263479001124 = (3.618609356118859 - 48.65315622059667) / 3.618609356118859 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.2811916070475 > 2.393539544367895. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.53672471864574 (T) = (0 -34.75928513386754) / Math.Sqrt((0.2859138416941013 / (33)) + (15.458329584493379 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.69922648144071 = (2.2140762906350338 - 34.75928513386754) / 2.2140762906350338 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.15220009500956 > 3.3066701219311763. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.6054052264996 (T) = (0 -40.46037296132851) / Math.Sqrt((0.5105559518381065 / (33)) + (5.8536977982713125 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.48321519428894 = (3.241182045779287 - 40.46037296132851) / 3.241182045779287 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.59956639273058 > 3.561988392470979. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -65.09933446084942 (T) = (0 -49.59466885087497) / Math.Sqrt((0.5517407244176538 / (32)) + (1.953540417357928 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.009632029296439 = (3.3041895200411298 - 49.59466885087497) / 3.3041895200411298 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.36238994828564 > 2.1616573370867216. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -102.0142436316825 (T) = (0 -16.610282172761607) / Math.Sqrt((0.3716801938279098 / (32)) + (0.033518888482575344 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.601295267988158 = (2.1851910216820016 - 16.610282172761607) / 2.1851910216820016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.959519867507005 > 2.717349377979366. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.504598213056354 (T) = (0 -50.31102599634034) / Math.Sqrt((1.0883808961791606 / (32)) + (14.917055705851178 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.13563592877133 = (2.774152844374444 - 50.31102599634034) / 2.774152844374444 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.86279964155031 > 3.4720045682517773. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -67.12686534431826 (T) = (0 -67.75270405840337) / Math.Sqrt((2.16196156929844 / (33)) + (3.3756641171826285 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.126294778138142 = (3.7378132093558856 - 67.75270405840337) / 3.7378132093558856 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.23518903682771 > 3.488568643932677. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -110.94296489113528 (T) = (0 -49.4834907896721) / Math.Sqrt((0.35036317794301175 / (32)) + (0.6494798998210586 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.01235507054392 = (3.2961844132480436 - 49.4834907896721) / 3.2961844132480436 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.07929274669889 > 6.083862217891215. IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.77536830101091 (T) = (0 -43.88333889712481) / Math.Sqrt((0.6600120092982911 / (32)) + (3.7469793236165985 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.383460739879633 = (5.943464784758943 - 43.88333889712481) / 5.943464784758943 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.976093340120585 > 3.4457105824345615. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.26968396354692 (T) = (0 -58.477662731418874) / Math.Sqrt((0.9889089529253796 / (33)) + (32.55828756659106 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -16.197939990758975 = (3.4002713559205846 - 58.477662731418874) / 3.4002713559205846 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.11892610032937 > 2.4505228270834394. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.768238640936698 (T) = (0 -49.18794346333227) / Math.Sqrt((0.8319684214504325 / (32)) + (9.104205591475436 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -18.63743813562144 = (2.504804502686505 - 49.18794346333227) / 2.504804502686505 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.3313332129815 > 2.53930760697778. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.03574107133962 (T) = (0 -49.655994559049724) / Math.Sqrt((0.3038856390559805 / (33)) + (5.821904147953723 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.575823901314777 = (2.4133174349279276 - 49.655994559049724) / 2.4133174349279276 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.740839918643246 > 2.646386058546879. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.791821978192804 (T) = (0 -52.95514796000254) / Math.Sqrt((0.33057102145622475 / (33)) + (14.12380078422242 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.8505542062944 = (2.539747741765845 - 52.95514796000254) / 2.539747741765845 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.634558523921587 > 0.05054801989993669. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -57.51909500938019 (T) = (0 -15.06116889387874) / Math.Sqrt((0.2621808024152493 / (33)) + (0.23204103298463452 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -51.06619964365573 = (0.2892696028701596 - 15.06116889387874) / 0.2892696028701596 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).ZeroBenchmark.html>)	1.94 ns	16.60 ns	8.56	0.64	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).MinBenchmark.html>)	2.35 ns	38.81 ns	16.54	0.55	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualAllBenchmark.html>)	2.36 ns	31.73 ns	13.45	0.66	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseAndOperatorBenchmark.html>)	2.72 ns	50.92 ns	18.71	0.65	True
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).DivisionOperatorBenchmark.html>)	3.38 ns	31.62 ns	9.36	0.60	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).EqualsAllBenchmark.html>)	2.41 ns	32.56 ns	13.49	0.71	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualAnyBenchmark.html>)	2.42 ns	21.46 ns	8.89	0.72	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanBenchmark.html>)	3.21 ns	45.67 ns	14.23	0.56	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).XorBenchmark.html>)	3.27 ns	53.99 ns	16.50	0.56	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanAllBenchmark.html>)	1.78 ns	18.04 ns	10.16	0.65	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).EqualityOperatorBenchmark.html>)	2.07 ns	17.20 ns	8.32	0.72	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementBenchmark.html>)	6.40 ns	47.29 ns	7.38	0.63	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanAnyBenchmark.html>)	2.50 ns	40.81 ns	16.33	0.63	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).SubtractBenchmark.html>)	3.63 ns	49.23 ns	13.57	0.60	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).LessThanAnyBenchmark.html>)	3.46 ns	20.11 ns	5.81	0.67	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).MaxBenchmark.html>)	3.24 ns	35.11 ns	10.83	0.61	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseOrBenchmark.html>)	4.17 ns	51.89 ns	12.43	0.57	True
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).EqualsStaticBenchmark.html>)	3.45 ns	37.97 ns	11.00	0.52	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AddBenchmark.html>)	3.33 ns	41.86 ns	12.58	0.56	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).ConditionalSelectBenchmark.html>)	3.39 ns	180.16 ns	53.17	0.62	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AndNotBenchmark.html>)	4.07 ns	85.77 ns	21.09	0.57	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementOperatorBenchmark.html>)	4.69 ns	40.67 ns	8.67	0.64	True
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).MultiplyBenchmark.html>)	3.15 ns	40.45 ns	12.85	0.60	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseAndBenchmark.html>)	3.27 ns	53.47 ns	16.33	0.54	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualBenchmark.html>)	4.51 ns	46.73 ns	10.36	0.58	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).LessThanAllBenchmark.html>)	2.40 ns	33.02 ns	13.73	0.63	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).EqualsAnyBenchmark.html>)	2.60 ns	32.53 ns	12.51	0.64	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AbsBenchmark.html>)	3.17 ns	34.73 ns	10.95	0.55	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).CountBenchmark.html>)	0.00 ns	16.34 ns	∞	0.92	True
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).ExclusiveOrOperatorBenchmark.html>)	3.57 ns	52.98 ns	14.84	0.58	True
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).InequalityOperatorBenchmark.html>)	2.36 ns	17.33 ns	7.35	0.72	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualAnyBenchmark.html>)	2.61 ns	31.80 ns	12.19	0.62	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanOrEqualAllBenchmark.html>)	2.49 ns	17.82 ns	7.14	0.69	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).DivideBenchmark.html>)	5.41 ns	44.46 ns	8.21	0.58	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseOrOperatorBenchmark.html>)	3.24 ns	52.72 ns	16.27	0.54	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Single>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.600489135639478 > 2.0675583653590954. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -155.69142705325925 (T) = (0 -16.571282558949875) / Math.Sqrt((0.25538108509960417 / (33)) + (0.003801160434739853 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.050393292936985 = (2.058443849381706 - 16.571282558949875) / 2.058443849381706 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.805839652061046 > 3.4686596161084706. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.7811026826025 (T) = (0 -37.04509353879793) / Math.Sqrt((0.24212574528376354 / (33)) + (2.035716404500678 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.793741484488695 = (3.4320901229693264 - 37.04509353879793) / 3.4320901229693264 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.727671568559924 > 2.437741222274245. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.03926508285252 (T) = (0 -34.4178953790159) / Math.Sqrt((1.134989590339882 / (33)) + (9.023774460373383 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.353904087179258 = (2.577365776654008 - 34.4178953790159) / 2.577365776654008 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.918770541251156 > 3.5094873735124414. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -43.676027469102785 (T) = (0 -53.91713691954628) / Math.Sqrt((2.291309408588536 / (33)) + (4.961206985964947 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.709995745528953 = (3.9326880854160375 - 53.91713691954628) / 3.9326880854160375 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.61982990665034 > 3.491273438463916. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.078746016181256 (T) = (0 -33.16049021622623) / Math.Sqrt((1.3320171298933285 / (32)) + (7.735785826388214 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.385266190924462 = (3.5332498345430388 - 33.16049021622623) / 3.5332498345430388 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.56151996766886 > 2.3972805486938453. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.430875478981434 (T) = (0 -29.256698715730465) / Math.Sqrt((0.3553260525651397 / (33)) + (12.006861213803413 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.825228949161106 = (2.4740915242749666 - 29.256698715730465) / 2.4740915242749666 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.464615346664967 > 2.4991580946718575. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.06801793494379 (T) = (0 -19.939900316501266) / Math.Sqrt((0.4374683512137856 / (32)) + (1.7156047259052745 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.675488700120982 = (2.5978671971970946 - 19.939900316501266) / 2.5978671971970946 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.6667696090782 > 3.3646589449661475. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.581788176306368 (T) = (0 -41.61009795616459) / Math.Sqrt((1.1188157840328536 / (33)) + (7.524465768652249 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.091570634184711 = (3.4412483882388702 - 41.61009795616459) / 3.4412483882388702 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.9855819579496 > 3.538710686052303. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -72.8823093589632 (T) = (0 -52.3837841694933) / Math.Sqrt((0.3378841770504186 / (31)) + (1.7712568884398028 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -14.914778279444354 = (3.291518313965617 - 52.3837841694933) / 3.291518313965617 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.044265949930157 > 2.541554589110285. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.45656576815491 (T) = (0 -19.22412659025133) / Math.Sqrt((1.3753828159235784 / (33)) + (3.7579023706022405 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.5760160353307855 = (2.9233697860477195 - 19.22412659025133) / 2.9233697860477195 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.196234692127796 > 2.1936081213147838. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.932435862414867 (T) = (0 -19.835731603582808) / Math.Sqrt((0.6260158429807486 / (32)) + (5.418228215965571 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.5077044008619565 = (2.331502208935839 - 19.835731603582808) / 2.331502208935839 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.29488265905461 > 3.7537052192451057. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.616425743921646 (T) = (0 -41.79222785692738) / Math.Sqrt((0.8989916368465412 / (31)) + (13.599989293378714 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.558685490331587 = (3.615655767421394 - 41.79222785692738) / 3.615655767421394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.80918461714772 > 2.622550817731154. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.939574267217804 (T) = (0 -35.93794536809193) / Math.Sqrt((1.106037943601376 / (32)) + (15.296196655134644 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.49557412499674 = (2.662943053421272 - 35.93794536809193) / 2.662943053421272 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.22789354461458 > 3.064608242705715. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.753462398848502 (T) = (0 -43.844313324895154) / Math.Sqrt((0.7544003825948729 / (32)) + (34.56324205802883 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.046785718301198 = (3.3605452156229676 - 43.844313324895154) / 3.3605452156229676 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.110077023655823 > 2.9037668363437654. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.77306249272046 (T) = (0 -21.50445924915466) / Math.Sqrt((0.3790216055510755 / (32)) + (0.9407132603720737 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.8749998018784675 = (2.730725052720012 - 21.50445924915466) / 2.730725052720012 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.107593620584595 > 3.37768335065299. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.792348247901717 (T) = (0 -38.297647567767484) / Math.Sqrt((1.1095526700101437 / (32)) + (12.372849181830334 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.629180552508824 = (3.2932369907616006 - 38.297647567767484) / 3.2932369907616006 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.887872974163855 > 3.7301223322239143. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -79.55955738575065 (T) = (0 -52.618322592662075) / Math.Sqrt((0.3623291342221707 / (33)) + (1.4832137261228142 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.209425998229706 = (3.45958635117371 - 52.618322592662075) / 3.45958635117371 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.971885320754176 > 3.544198374950286. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -66.57298118202284 (T) = (0 -39.11850607384535) / Math.Sqrt((0.5996678549182843 / (32)) + (1.0784804710515659 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.609969278330313 = (3.3693892839888013 - 39.11850607384535) / 3.3693892839888013 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.85614893628693 > 3.429554359455509. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.789383808457863 (T) = (0 -42.51650310946801) / Math.Sqrt((0.6299005253413609 / (33)) + (8.43417603157357 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.35792250137747 = (3.4404248047945707 - 42.51650310946801) / 3.4404248047945707 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 180.15524249436547 > 3.6358688673251205. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -153.52730837718698 (T) = (0 -177.06871781546482) / Math.Sqrt((0.4354953953002896 / (33)) + (5.054086623061356 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -48.25155391738163 = (3.595190480943883 - 177.06871781546482) / 3.595190480943883 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.77364139193689 > 3.7354300891117003. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -62.39356086681552 (T) = (0 -87.33094077611189) / Math.Sqrt((0.621038932000632 / (32)) + (7.168795947409599 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -25.05535071931532 = (3.3517468913351385 - 87.33094077611189) / 3.3517468913351385 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.670024169785094 > 4.964591160577061. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.50338078137791 (T) = (0 -41.06590286213833) / Math.Sqrt((0.8795802311696884 / (31)) + (2.8037558065583457 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.612629892737111 = (4.76810258580466 - 41.06590286213833) / 4.76810258580466 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.44951486036059 > 3.328658347037486. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.397579742603504 (T) = (0 -41.051759239667255) / Math.Sqrt((1.2505279811716827 / (33)) + (4.11591723379732 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.875496863334313 = (3.4568456134593304 - 41.051759239667255) / 3.4568456134593304 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.46510206349659 > 3.4423657249112876. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -150.65229396699274 (T) = (0 -52.914318719142145) / Math.Sqrt((0.4045533499334716 / (32)) + (0.3830339893220069 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.971034195120188 = (3.3131429106394163 - 52.914318719142145) / 3.3131429106394163 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.73111484768602 > 3.407504238864398. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.101530501320905 (T) = (0 -43.28142998502059) / Math.Sqrt((0.802692432387942 / (33)) + (15.895298550157888 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.017487861671395 = (3.0876737980538453 - 43.28142998502059) / 3.0876737980538453 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.015865595889345 > 2.6350765476403777. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -99.86803732336152 (T) = (0 -32.62161592629708) / Math.Sqrt((0.5359431805887553 / (33)) + (0.29539471979483983 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.327110911248008 = (2.6463310147174166 - 32.62161592629708) / 2.6463310147174166 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.52761831373938 > 2.702788690790438. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.865370281497043 (T) = (0 -33.20166412641717) / Math.Sqrt((0.6255524983843971 / (33)) + (16.93018262000797 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.01768673683192 = (2.550504156201363 - 33.20166412641717) / 2.550504156201363 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.733581800296854 > 3.4173686715865097. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.28062119762511 (T) = (0 -35.131946694663114) / Math.Sqrt((0.502956282785799 / (31)) + (12.193586558157918 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.225041362030566 = (3.1297832730932478 - 35.131946694663114) / 3.1297832730932478 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.338706193325404 > 0.026939916972507215. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.233684944862134 (T) = (0 -15.177116668043723) / Math.Sqrt((0.05316063402050029 / (33)) + (0.6156531755190953 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -152.2008801570472 = (0.09906677202171138 - 15.177116668043723) / 0.09906677202171138 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.98189946058485 > 3.6432387596505444. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -88.27054437547783 (T) = (0 -52.9437324427302) / Math.Sqrt((2.2514866485836547 / (33)) + (0.9666232078463796 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.910323487249867 = (3.8060748544962424 - 52.9437324427302) / 3.8060748544962424 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.331438459411594 > 2.8248342839964042. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.694448592688953 (T) = (0 -17.980126357105554) / Math.Sqrt((0.6698226150867308 / (33)) + (1.230445088830348 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.674148755452535 = (2.6939954465978078 - 17.980126357105554) / 2.6939954465978078 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.798632707582136 > 2.75515531023832. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.22608543833717 (T) = (0 -34.517111179249056) / Math.Sqrt((0.34271164056713205 / (33)) + (6.860699288672411 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.81455482978946 = (2.6935864442991475 - 34.517111179249056) / 2.6935864442991475 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.81838934044681 > 2.6373524093831064. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.860427105612846 (T) = (0 -19.667327495929705) / Math.Sqrt((0.5529539636290443 / (33)) + (3.1939354346140463 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.455036076249814 = (2.6381264013712418 - 19.667327495929705) / 2.6381264013712418 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.45691403391071 > 3.680868412689146. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.042586614744266 (T) = (0 -40.59150497853317) / Math.Sqrt((0.6024325389908165 / (33)) + (11.249218762078083 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -10.190486885432433 = (3.6273225101022577 - 40.59150497853317) / 3.6273225101022577 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.722579314024706 > 3.488084433859168. IsChangePoint: Marked as a change because one of 3/1/2023 11:57:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -272.34554425103437 (T) = (0 -52.34428705857326) / Math.Sqrt((0.4342061136485887 / (33)) + (0.07685713703330782 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.656745651641561 = (3.3432418347477673 - 52.34428705857326) / 3.3432418347477673 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).DotBenchmark.html>)	4.45 ns	37.79 ns	8.50	0.85	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).MaxBenchmark.html>)	1.90 ns	41.86 ns	21.99	0.58	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).AbsBenchmark.html>)	3.19 ns	42.91 ns	13.46	0.59	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).BitwiseAndOperatorBenchmark.html>)	3.33 ns	48.60 ns	14.58	0.56	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanAnyBenchmark.html>)	2.42 ns	39.54 ns	16.37	0.62	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanOrEqualAnyBenchmark.html>)	2.72 ns	36.06 ns	13.27	0.64	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanAnyBenchmark.html>)	2.36 ns	36.88 ns	15.64	0.65	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanOrEqualAllBenchmark.html>)	2.79 ns	27.44 ns	9.85	0.69	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).BitwiseAndBenchmark.html>)	3.28 ns	48.13 ns	14.69	0.61	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).ConditionalSelectBenchmark.html>)	4.27 ns	52.01 ns	12.19	0.65	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).DivideBenchmark.html>)	3.35 ns	58.12 ns	17.34	0.62	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).SquareRootBenchmark.html>)	21.88 ns	37.25 ns	1.70	0.69	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).InequalityOperatorBenchmark.html>)	2.47 ns	25.14 ns	10.18	0.74	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanBenchmark.html>)	2.09 ns	45.05 ns	21.60	0.63	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).MinBenchmark.html>)	3.36 ns	43.10 ns	12.81	0.59	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanOrEqualAllBenchmark.html>)	2.45 ns	26.62 ns	10.87	0.69	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).BitwiseOrOperatorBenchmark.html>)	2.95 ns	52.56 ns	17.80	0.66	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanOrEqualBenchmark.html>)	3.33 ns	46.26 ns	13.90	0.60	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).SubtractionOperatorBenchmark.html>)	3.48 ns	41.92 ns	12.05	0.66	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).XorBenchmark.html>)	3.26 ns	48.13 ns	14.75	0.59	True
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanOrEqualBenchmark.html>)	3.36 ns	42.06 ns	12.53	0.70	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).CountBenchmark.html>)	0.16 ns	14.90 ns	93.37	0.86	True
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).AllBitsSetBenchmark.html>)	2.01 ns	29.88 ns	14.84	0.66	True
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).NegateBenchmark.html>)	13.84 ns	71.02 ns	5.13	0.60	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).SumBenchmark.html>)	1.59 ns	25.32 ns	15.94	0.87	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).EqualsStaticBenchmark.html>)	3.15 ns	44.82 ns	14.23	0.62	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).AddOperatorBenchmark.html>)	5.12 ns	48.03 ns	9.38	0.64	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).MultiplyOperatorBenchmark.html>)	3.18 ns	38.73 ns	12.19	0.65	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanOrEqualAnyBenchmark.html>)	2.50 ns	37.30 ns	14.92	0.69	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).AddBenchmark.html>)	3.31 ns	48.20 ns	14.55	0.56	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).EqualsAnyBenchmark.html>)	2.53 ns	40.51 ns	16.03	0.66	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).OnesComplementBenchmark.html>)	2.96 ns	72.73 ns	24.60	0.59	True
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).UnaryNegateOperatorBenchmark.html>)	13.72 ns	58.83 ns	4.29	0.64	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).ZeroBenchmark.html>)	1.85 ns	16.85 ns	9.09	0.62	True
[EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).EqualsBenchmark.html>)	5.52 ns	126.08 ns	22.86	0.63	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).SubtractBenchmark.html>)	3.72 ns	49.08 ns	13.21	0.64	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).ExclusiveOrOperatorBenchmark.html>)	4.84 ns	49.81 ns	10.29	0.60	True
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).LessThanAllBenchmark.html>)	2.46 ns	25.71 ns	10.47	0.66	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).EqualityOperatorBenchmark.html>)	1.94 ns	27.16 ns	13.99	0.72	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).DivisionOperatorBenchmark.html>)	3.34 ns	43.32 ns	12.95	0.62	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).EqualsAllBenchmark.html>)	2.21 ns	42.94 ns	19.40	0.72	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).OnesComplementOperatorBenchmark.html>)	6.01 ns	42.64 ns	7.09	0.59	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanAllBenchmark.html>)	1.20 ns	30.64 ns	25.44	0.66	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).BitwiseOrBenchmark.html>)	3.59 ns	48.78 ns	13.58	0.57	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).AndNotBenchmark.html>)	3.31 ns	48.67 ns	14.68	0.60	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).GreaterThanBenchmark.html>)	3.43 ns	44.14 ns	12.89	0.63	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Double).MultiplyBenchmark.html>)	2.67 ns	59.04 ns	22.11	0.53	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.785163434461516 > 2.1571458966466577. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.894980403505594 (T) = (0 -45.430525853885136) / Math.Sqrt((4.340095242124842 / (32)) + (27.81004971411947 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.596497018431474 = (3.1124266182850944 - 45.430525853885136) / 3.1124266182850944 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.862907929193625 > 2.9509833999423845. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -48.544623146275576 (T) = (0 -42.91837524072844) / Math.Sqrt((1.7360591893646233 / (31)) + (2.431310372835038 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -11.749466905473621 = (3.366287826693574 - 42.91837524072844) / 3.366287826693574 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.90513597099165 > 3.5178264293923966. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -78.0264952430172 (T) = (0 -42.88207684813008) / Math.Sqrt((0.731106455175163 / (33)) + (0.948342821892484 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.59449127774273 = (3.154371573899038 - 42.88207684813008) / 3.154371573899038 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.59758765075191 > 3.5616606027772124. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -123.55886685210001 (T) = (0 -49.02987878455931) / Math.Sqrt((0.9647358994612281 / (32)) + (0.4235673842523817 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.183003847393694 = (3.4569460258285956 - 49.02987878455931) / 3.4569460258285956 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.54047198942688 > 2.6387696250539454. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.98356796606565 (T) = (0 -39.257143030121355) / Math.Sqrt((1.235576165318518 / (33)) + (7.763914286667724 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.488113903157585 = (2.709610325576301 - 39.257143030121355) / 2.709610325576301 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.05836596424693 > 2.645774078456017. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.128815971348736 (T) = (0 -40.92150550657642) / Math.Sqrt((0.6812037374254512 / (33)) + (22.251876928490095 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.564627637073922 = (2.80964996334075 - 40.92150550657642) / 2.80964996334075 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.88290890314643 > 2.6430457450417104. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.982001398460806 (T) = (0 -38.90080491830281) / Math.Sqrt((0.36324118409352635 / (32)) + (14.572160191309424 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.882095028660759 = (2.6139333772150692 - 38.90080491830281) / 2.6139333772150692 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.44221316825974 > 2.723399647471524. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.556449217200477 (T) = (0 -29.65954086157977) / Math.Sqrt((0.6007222779386279 / (33)) + (25.82352118688154 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.594669054791717 = (2.799477804185442 - 29.65954086157977) / 2.799477804185442 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.127045105455 > 3.446693093597352. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.891358549099756 (T) = (0 -49.482456148999646) / Math.Sqrt((3.419158634346529 / (32)) + (3.2123071377934234 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.025530701046955 = (3.798882155720717 - 49.482456148999646) / 3.798882155720717 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.014969517545104 > 3.829841552278082. IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -92.8352569138404 (T) = (0 -52.923659996080794) / Math.Sqrt((1.0599001550865543 / (33)) + (0.9890479771074859 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.731208897643947 = (3.8542607858192035 - 52.923659996080794) / 3.8542607858192035 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.12001273876233 > 3.50944195668826. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.948970943639907 (T) = (0 -53.55536583280666) / Math.Sqrt((3.0999054140471025 / (33)) + (9.938830133950342 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.885158088966417 = (3.857022404041869 - 53.55536583280666) / 3.857022404041869 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.24834261461032 > 23.222673020862167. IsChangePoint: Marked as a change because one of 1/28/2023 8:08:27 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.057279054343594 (T) = (0 -38.6130676667141) / Math.Sqrt((10.143767089827287 / (32)) + (3.8623621566141524 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7015385389801448 = (22.693031501865192 - 38.6130676667141) / 22.693031501865192 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.139979343062187 > 2.559159755729152. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.054694663861762 (T) = (0 -26.999826396801936) / Math.Sqrt((0.3139754802991808 / (32)) + (19.62008397724577 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.833700226699992 = (2.4922072636143304 - 26.999826396801936) / 2.4922072636143304 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.04629264217097 > 3.5105640666478974. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.541910950323746 (T) = (0 -43.10591123084838) / Math.Sqrt((0.508637977887856 / (33)) + (12.486870226409303 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.556183426088909 = (3.1797969882799713 - 43.10591123084838) / 3.1797969882799713 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.10365686110179 > 4.157734690739998. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.78727286084861 (T) = (0 -42.616071487711025) / Math.Sqrt((1.5586649275794051 / (31)) + (7.060147841650046 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.127146476232774 = (3.8299191602031644 - 42.616071487711025) / 3.8299191602031644 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.6185003441378 > 2.596371029397886. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.29964570420084 (T) = (0 -27.53224846573505) / Math.Sqrt((1.0988794455504078 / (33)) + (6.538714114055867 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.562052752855509 = (2.6067137809259244 - 27.53224846573505) / 2.6067137809259244 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.55634000809466 > 3.4929815872755396. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.0682908313989 (T) = (0 -50.10742750098003) / Math.Sqrt((0.6312853341662876 / (33)) + (5.6154276452696905 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.30312440657093 = (3.5032504840662937 - 50.10742750098003) / 3.5032504840662937 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.262271510334166 > 3.4477555377945928. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.838126985456704 (T) = (0 -43.23653492042683) / Math.Sqrt((1.6198620201203073 / (33)) + (11.963480685861782 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.652686583626734 = (3.4171821640138673 - 43.23653492042683) / 3.4171821640138673 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.91512609444341 > 3.5530500820457305. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -89.91908019638103 (T) = (0 -42.14426581934714) / Math.Sqrt((2.010094799094428 / (32)) + (0.4835111285151274 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.689068292788281 = (3.6054426891618534 - 42.14426581934714) / 3.6054426891618534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.13264673126749 > 3.5190323267596377. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.193912634970694 (T) = (0 -49.06552935091024) / Math.Sqrt((0.43586054776465916 / (33)) + (4.191001302000313 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.842525824865948 = (3.544550320633799 - 49.06552935091024) / 3.544550320633799 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.064974619436335 > 3.499735497988862. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -49.14953467796843 (T) = (0 -41.35526140516221) / Math.Sqrt((2.5224636333155774 / (32)) + (2.029911288857563 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.113433763200625 = (3.7211956526073773 - 41.35526140516221) / 3.7211956526073773 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.903639666790507 > 0.43569021368981753. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.553549431093575 (T) = (0 -15.808620555029027) / Math.Sqrt((0.135529768761201 / (33)) + (3.5264758945938564 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -67.85998572177762 = (0.2295762973129604 - 15.808620555029027) / 0.2295762973129604 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.881178468057776 > 2.0799524222099066. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -247.73543883994478 (T) = (0 -30.04722199485294) / Math.Sqrt((0.3165404410785736 / (33)) + (0.012667433820779598 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.557135327865172 = (2.064088937700314 - 30.04722199485294) / 2.064088937700314 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.02162713125537 > 14.57676910555646. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.292279874234788 (T) = (0 -75.02229723698468) / Math.Sqrt((1.190412309604707 / (32)) + (139.06152708352639 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -4.244731401565392 = (14.304316368726303 - 75.02229723698468) / 14.304316368726303 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.323493270865523 > 1.696442414463319. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.131058520676493 (T) = (0 -27.744214547260437) / Math.Sqrt((4.239278911026127 / (33)) + (3.3425127787821265 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.296292818355758 = (2.0866127819446847 - 27.744214547260437) / 2.0866127819446847 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.824872941660686 > 3.477138823776034. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.86080911376359 (T) = (0 -41.70190263946128) / Math.Sqrt((1.09509446577407 / (33)) + (7.418245569060841 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.184745052189424 = (3.42246821421742 - 41.70190263946128) / 3.42246821421742 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.0307288110337 > 4.7650609977108225. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.793948521217175 (T) = (0 -47.14980314464385) / Math.Sqrt((1.3747760672509726 / (32)) + (64.0814454622005 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.124963954602107 = (3.888655118578545 - 47.14980314464385) / 3.888655118578545 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.73201524384069 > 3.6977765851255846. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.509467246854232 (T) = (0 -40.86337871339268) / Math.Sqrt((0.8258247234334084 / (32)) + (13.318257532418874 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.402357069204278 = (3.2948074696912775 - 40.86337871339268) / 3.2948074696912775 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.30051965355282 > 2.6347804657012834. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.400438588115552 (T) = (0 -43.87961985754146) / Math.Sqrt((0.4104637027658994 / (32)) + (52.522196992814635 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -16.216444406810112 = (2.548703949590457 - 43.87961985754146) / 2.548703949590457 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.20112377788316 > 3.372745482211746. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.940118162081996 (T) = (0 -55.10643169926105) / Math.Sqrt((0.28051828017741837 / (33)) + (89.44497113149312 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.38451729519671 = (3.3633234782825165 - 55.10643169926105) / 3.3633234782825165 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.5077533842837 > 2.6859727291240567. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.34761520606061 (T) = (0 -38.743848310464216) / Math.Sqrt((0.7348844760258991 / (33)) + (8.022177458427374 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.628546925770726 = (2.6485096918416553 - 38.743848310464216) / 2.6485096918416553 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 72.72828251707583 > 3.1949289013724558. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.505429129294578 (T) = (0 -50.83759537625408) / Math.Sqrt((0.2528797399029774 / (33)) + (213.6529876647974 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.45371606733488 = (3.289668009606536 - 50.83759537625408) / 3.289668009606536 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.832085935826015 > 15.127760843980187. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.615848678808355 (T) = (0 -61.26604080914555) / Math.Sqrt((2.9191031749917578 / (32)) + (2.7265198464979115 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -3.081573626159689 = (15.01039707246201 - 61.26604080914555) / 15.01039707246201 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.847898152828574 > 2.7441923092677505. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.40958822329352 (T) = (0 -17.039736424241042) / Math.Sqrt((1.2445795789820373 / (33)) + (0.8288206410667062 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.856708690179074 = (2.4851189096960193 - 17.039736424241042) / 2.4851189096960193 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 126.07644399698658 > 6.216038238369385. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.93626864504322 (T) = (0 -128.46751011068784) / Math.Sqrt((1.9225740365564352 / (33)) + (36.95842522219068 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.196511230566767 = (6.692232175299018 - 128.46751011068784) / 6.692232175299018 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.07806594694536 > 3.5306241242636545. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.000807162517038 (T) = (0 -53.29878594249725) / Math.Sqrt((1.058456310722924 / (32)) + (15.782720828447074 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.538453722443997 = (3.430121612777442 - 53.29878594249725) / 3.430121612777442 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.81396241445659 > 3.744804906793179. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -97.0639708864762 (T) = (0 -49.13649427148652) / Math.Sqrt((1.0111207184605766 / (31)) + (0.7444200327837907 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -12.131413145328628 = (3.7419045252541117 - 49.13649427148652) / 3.7419045252541117 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.706998825051148 > 2.4639878639959236. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.48551106298929 (T) = (0 -26.878087410319775) / Math.Sqrt((1.1341612273644612 / (32)) + (1.2496276137954616 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.150667962337334 = (2.4104463966735996 - 26.878087410319775) / 2.4104463966735996 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.155868667275953 > 2.3545316817765682. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.852120234626945 (T) = (0 -27.787655094704864) / Math.Sqrt((0.38502439375650954 / (31)) + (2.189240770004787 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.290525427518556 = (2.461148090325152 - 27.787655094704864) / 2.461148090325152 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.31573034779144 > 3.46627074007057. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.26227329974056 (T) = (0 -42.64722449590193) / Math.Sqrt((2.491833708692398 / (32)) + (9.970932328383318 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.380849243477847 = (3.7472796259332104 - 42.64722449590193) / 3.7472796259332104 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.943270321824414 > 2.7340217240178193. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.168593297155006 (T) = (0 -41.087800110101554) / Math.Sqrt((0.6021073744708764 / (32)) + (22.67494542042088 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.253177558070691 = (2.527985679310995 - 41.087800110101554) / 2.527985679310995 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.63595761013074 > 7.04153726311427. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -147.13066584446725 (T) = (0 -42.4149724188457) / Math.Sqrt((1.6780158315547276 / (33)) + (0.036316174783174206 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.630349578706102 = (6.397094439042064 - 42.4149724188457) / 6.397094439042064 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.63909195545616 > 2.629272104321048. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.11546648380671 (T) = (0 -28.78536751575175) / Math.Sqrt((0.2122368924029261 / (33)) + (2.096650429758102 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.615523723027602 = (2.4781807692997253 - 28.78536751575175) / 2.4781807692997253 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.777527221663725 > 3.605074018102045. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -60.25060171926063 (T) = (0 -48.78920199176495) / Math.Sqrt((0.6475110396997595 / (32)) + (2.166710326052334 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.459598896515558 = (3.6248629968011583 - 48.78920199176495) / 3.6248629968011583 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.66551895843619 > 3.5541573433313154. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.82233071707574 (T) = (0 -51.12696531530653) / Math.Sqrt((1.0288038526583514 / (33)) + (14.179784807299967 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -13.49419255017224 = (3.5274103844231712 - 51.12696531530653) / 3.5274103844231712 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.141671268687396 > 3.3267544397926545. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.500055519533475 (T) = (0 -42.15096587338065) / Math.Sqrt((0.6611002654953113 / (33)) + (14.263270120343698 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.652789554241242 = (3.3313575391958965 - 42.15096587338065) / 3.3313575391958965 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.035039616484326 > 3.3981994680667547. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.340668549252165 (T) = (0 -54.98457934313066) / Math.Sqrt((0.34977218257283976 / (32)) + (7.622585471241853 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.712753699258828 = (3.2899772432815246 - 54.98457934313066) / 3.2899772432815246 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).BitwiseOrOperatorBenchmark.html>)	3.28 ns	53.16 ns	16.19	0.58	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).ConditionalSelectBenchmark.html>)	3.50 ns	51.80 ns	14.81	0.65	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).BitwiseOrBenchmark.html>)	2.62 ns	47.78 ns	18.25	0.60	True
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).ExclusiveOrOperatorBenchmark.html>)	3.00 ns	46.99 ns	15.67	0.61	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).BitwiseAndBenchmark.html>)	2.29 ns	48.35 ns	21.08	0.61	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).EqualityOperatorBenchmark.html>)	2.23 ns	17.16 ns	7.69	0.74	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanOrEqualAllBenchmark.html>)	2.35 ns	40.81 ns	17.34	0.74	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).OnesComplementBenchmark.html>)	3.16 ns	44.80 ns	14.16	0.66	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanOrEqualAnyBenchmark.html>)	2.66 ns	115.81 ns	43.49	0.53	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).EqualsAllBenchmark.html>)	2.50 ns	27.47 ns	10.98	0.71	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).DivisionOperatorBenchmark.html>)	102.56 ns	115.86 ns	1.13	0.12	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).EqualsStaticBenchmark.html>)	3.72 ns	132.76 ns	35.66	0.40	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).AbsBenchmark.html>)	5.80 ns	33.79 ns	5.83	0.61	True
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).BitwiseAndOperatorBenchmark.html>)	3.42 ns	49.27 ns	14.43	0.62	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).XorBenchmark.html>)	3.29 ns	48.41 ns	14.73	0.61	True
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).EqualsAnyBenchmark.html>)	2.53 ns	121.46 ns	47.98	0.48	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).OnesComplementOperatorBenchmark.html>)	5.69 ns	41.67 ns	7.33	0.65	True
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanBenchmark.html>)	3.34 ns	141.15 ns	42.29	0.42	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanOrEqualBenchmark.html>)	4.60 ns	183.31 ns	39.88	0.46	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).AllBitsSetBenchmark.html>)	1.95 ns	29.84 ns	15.31	0.64	True
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SubtractionOperatorBenchmark.html>)	3.24 ns	98.08 ns	30.27	0.43	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).ZeroBenchmark.html>)	2.08 ns	16.76 ns	8.06	0.64	True
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).InequalityOperatorBenchmark.html>)	2.51 ns	20.04 ns	7.99	0.71	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanOrEqualBenchmark.html>)	3.40 ns	126.17 ns	37.14	0.38	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).CountBenchmark.html>)	0.00 ns	16.86 ns	∞	0.92	True
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanOrEqualAnyBenchmark.html>)	2.62 ns	34.10 ns	13.01	0.70	False
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SumBenchmark.html>)	2.39 ns	108.33 ns	45.38	0.52	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).DotBenchmark.html>)	18.13 ns	175.05 ns	9.65	0.32	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).MultiplyBenchmark.html>)	16.19 ns	103.31 ns	6.38	0.37	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanAllBenchmark.html>)	2.47 ns	126.73 ns	51.25	0.47	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).MaxBenchmark.html>)	4.29 ns	138.80 ns	32.33	0.46	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanAnyBenchmark.html>)	2.46 ns	118.14 ns	48.05	0.50	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).MinBenchmark.html>)	6.12 ns	135.92 ns	22.23	0.45	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).AddBenchmark.html>)	3.54 ns	105.71 ns	29.84	0.41	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanBenchmark.html>)	3.99 ns	178.84 ns	44.78	0.46	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).NegateBenchmark.html>)	85.79 ns	104.91 ns	1.22	0.21	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).AndNotBenchmark.html>)	4.42 ns	47.79 ns	10.80	0.61	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SubtractBenchmark.html>)	2.46 ns	102.89 ns	41.80	0.45	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanOrEqualAllBenchmark.html>)	2.43 ns	118.03 ns	48.67	0.51	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).SquareRootBenchmark.html>)	110.53 ns	138.93 ns	1.26	0.28	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).GreaterThanAnyBenchmark.html>)	2.64 ns	25.89 ns	9.80	0.73	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).LessThanAllBenchmark.html>)	2.47 ns	34.03 ns	13.76	0.68	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Byte).DivideBenchmark.html>)	102.34 ns	130.54 ns	1.28	0.09	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.1631745096222 > 3.426782686538366. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.39090062111454 (T) = (0 -49.69785421480459) / Math.Sqrt((1.1344453490225368 / (32)) + (5.409852619562845 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.098762306846652 = (3.2915184175241117 - 49.69785421480459) / 3.2915184175241117 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.79712605110049 > 3.7351939428258394. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -258.87998385799847 (T) = (0 -51.754805526153866) / Math.Sqrt((0.7031030604073116 / (33)) + (0.05217736971941254 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.71248846357717 = (3.7742825209023083 - 51.754805526153866) / 3.7742825209023083 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.781750770326155 > 3.4260657961809233. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.06747960198255 (T) = (0 -49.10148991029381) / Math.Sqrt((0.5706368501940999 / (33)) + (8.59101816478578 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.490633860159686 = (3.388498417953451 - 49.10148991029381) / 3.388498417953451 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.99287394674111 > 3.5812186500122203. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.436565041319824 (T) = (0 -49.3410388404189) / Math.Sqrt((0.8877195229647198 / (33)) + (7.346832911894929 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.351918709555234 = (3.695426845664379 - 49.3410388404189) / 3.695426845664379 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.34787266829787 > 3.9081466778341425. IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -79.43633044422855 (T) = (0 -49.428739008008456) / Math.Sqrt((1.1102950789832045 / (32)) + (1.205744227682213 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.650022266915576 = (3.373970230723425 - 49.428739008008456) / 3.373970230723425 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.155233538271553 > 2.3776032158620843. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.384991241597085 (T) = (0 -18.02151161219018) / Math.Sqrt((0.5969962091011446 / (33)) + (1.8883668725882803 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.6716671700059225 = (2.349099773599311 - 18.02151161219018) / 2.349099773599311 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.80955859020972 > 2.4898620920442625. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.10323861244778 (T) = (0 -33.69110965317758) / Math.Sqrt((0.5111156961682071 / (32)) + (31.636530492848536 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.843248231158189 = (2.4337575322348193 - 33.69110965317758) / 2.4337575322348193 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.80226783127737 > 3.473608570394822. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.790037893922964 (T) = (0 -44.387429213227826) / Math.Sqrt((1.91168528757513 / (32)) + (5.576798886137488 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.182319568048872 = (3.6435942240133623 - 44.387429213227826) / 3.6435942240133623 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 115.81200190787135 > 2.5489481027782332. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -200.86429051228671 (T) = (0 -116.81973969559837) / Math.Sqrt((0.1183137468234387 / (32)) + (1.2800533599129114 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -45.049189830368775 = (2.53684679634814 - 116.81973969559837) / 2.53684679634814 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.47239073246106 > 2.451812607356146. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.287878942278915 (T) = (0 -28.489969481698544) / Math.Sqrt((0.6350887759802373 / (33)) + (2.5108408907843804 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.306945883344676 = (2.519687435991425 - 28.489969481698544) / 2.519687435991425 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 115.86481475951584 > 108.02545483835549. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.192257381171056 (T) = (0 -117.60121800544073) / Math.Sqrt((3.3323798036959227 / (32)) + (20.288397750243238 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.13610094763902522 = (103.51300053910906 - 117.60121800544073) / 103.51300053910906 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 132.76110191277957 > 3.401124443470155. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -212.94213159206086 (T) = (0 -133.39807561743908) / Math.Sqrt((1.0533511557439006 / (33)) + (1.3639315480165033 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.66215199717515 = (3.36335949766266 - 133.39807561743908) / 3.36335949766266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.79213095724902 > 5.974938622365342. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.160166165217905 (T) = (0 -31.8268356730821) / Math.Sqrt((0.4499447856986364 / (33)) + (6.556456481452307 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -4.386097582566126 = (5.9090714910364985 - 31.8268356730821) / 5.9090714910364985 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.26773681962497 > 3.4958058247729515. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -129.87326050433452 (T) = (0 -49.06217943433993) / Math.Sqrt((0.8905823486532986 / (33)) + (0.28713472538180046 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -12.744265897329662 = (3.5696471387294757 - 49.06217943433993) / 3.5696471387294757 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.413718113108395 > 3.5459047498830243. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -84.93880545473485 (T) = (0 -49.56013313802415) / Math.Sqrt((1.058054132765932 / (33)) + (1.0500837039787478 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.327226499258742 = (3.4591575096958422 - 49.56013313802415) / 3.4591575096958422 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 121.45722035630841 > 2.731001147347825. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -48.32281369341354 (T) = (0 -119.30344574202857) / Math.Sqrt((0.3596242006099005 / (32)) + (23.235145716014866 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -42.765416250446705 = (2.725975346819896 - 119.30344574202857) / 2.725975346819896 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.66937753713517 > 6.218176638536722. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -97.24466740512614 (T) = (0 -41.904185162942724) / Math.Sqrt((2.0653428435833074 / (32)) + (0.28756547363014245 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.00149237235223 = (5.985036180060073 - 41.904185162942724) / 5.985036180060073 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 141.15434694416206 > 3.4895137374868503. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -55.937721074561004 (T) = (0 -136.4866137500578) / Math.Sqrt((1.4846537598251202 / (32)) + (22.31831233652837 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -34.84979651996444 = (3.807179593726553 - 136.4866137500578) / 3.807179593726553 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 183.30953453256302 > 4.1302414385389055. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -124.44013507551364 (T) = (0 -184.18962663181796) / Math.Sqrt((1.2719955669541536 / (31)) + (8.251585214640441 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -48.91389719710398 = (3.6901471729301214 - 184.18962663181796) / 3.6901471729301214 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.840852242265992 > 2.1577754650075187. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.87336958441289 (T) = (0 -30.577141141416305) / Math.Sqrt((1.1694634799041015 / (33)) + (1.0433119777555115 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.054404550141204 = (2.3422853967771027 - 30.577141141416305) / 2.3422853967771027 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 98.08243369838601 > 3.4980300559239343. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.06925372732298 (T) = (0 -100.41629640403428) / Math.Sqrt((3.0312293603256344 / (33)) + (18.950249942280816 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -27.127943738623728 = (3.5699835486427047 - 100.41629640403428) / 3.5699835486427047 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.7561787997619 > 2.0196675541851974. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -101.14488808170795 (T) = (0 -16.59785521733035) / Math.Sqrt((0.5631214556141498 / (32)) + (0.014882618147071319 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.070166010556449 = (1.8299395179771445 - 16.59785521733035) / 1.8299395179771445 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.044287389558544 > 2.6827448566038545. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.47417945854984 (T) = (0 -18.689573327752196) / Math.Sqrt((1.1238888209672855 / (33)) + (1.2845931628318106 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.419897526934616 = (2.911194960564445 - 18.689573327752196) / 2.911194960564445 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 126.16538474352846 > 3.509511238526106. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -180.4507289829902 (T) = (0 -127.15543098739026) / Math.Sqrt((0.4026815842868593 / (33)) + (1.3772845633446504 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -37.837659360379895 = (3.2740240550414694 - 127.15543098739026) / 3.2740240550414694 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.859669452133573 > 0.03612893106145508. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.751160150830696 (T) = (0 -16.210368877698482) / Math.Sqrt((0.06448820760951982 / (31)) + (2.646773187728096 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -135.62976902246825 = (0.11864448716906452 - 16.210368877698482) / 0.11864448716906452 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.10167477405479 > 2.5221810607230557. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.546908224160696 (T) = (0 -29.8390593798825) / Math.Sqrt((0.23830497810912551 / (32)) + (9.706108584621946 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.111097776478054 = (2.4637782578087477 - 29.8390593798825) / 2.4637782578087477 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 108.33301297551515 > 2.5366901000081845. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.751197237173443 (T) = (0 -100.49897089919146) / Math.Sqrt((0.8621481187571498 / (33)) + (74.00067573931894 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.06129795649705 = (2.572852827653555 - 100.49897089919146) / 2.572852827653555 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 175.05032581155982 > 19.348956401169428. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -80.13931478336553 (T) = (0 -169.81360029948414) / Math.Sqrt((0.6895726106864278 / (32)) + (14.10201478430569 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.993292060184657 = (18.882251256054214 - 169.81360029948414) / 18.882251256054214 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 103.30547339031092 > 17.034182269380963. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -65.80181213995999 (T) = (0 -106.89723239554772) / Math.Sqrt((2.7958235467535664 / (33)) + (7.078168398793543 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.181171832943393 = (17.294007557891277 - 106.89723239554772) / 17.294007557891277 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 126.73029395724257 > 2.560937371217531. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.05387947964354 (T) = (0 -120.56707571397754) / Math.Sqrt((0.4191103859164395 / (31)) + (31.39923299829881 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -44.64930092530913 = (2.6411593008017373 - 120.56707571397754) / 2.6411593008017373 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 138.79508350905778 > 3.7237344979479716. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.26593826542096 (T) = (0 -143.12279434607368) / Math.Sqrt((0.30729873664991714 / (33)) + (104.98922592888005 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -40.986013826382845 = (3.408820731063049 - 143.12279434607368) / 3.408820731063049 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 118.13754293942631 > 2.604944851511188. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -148.09073345495955 (T) = (0 -119.84410481772761) / Math.Sqrt((0.6654624197597819 / (33)) + (2.435252757196779 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -49.01753850452001 = (2.3960416366130746 - 119.84410481772761) / 2.3960416366130746 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 135.9212593454415 > 3.5385242191049406. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -136.11225405624387 (T) = (0 -136.20996989556477) / Math.Sqrt((0.5562143538224448 / (33)) + (3.738792767138729 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.64489555112247 = (3.4357505046247563 - 136.20996989556477) / 3.4357505046247563 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 105.70779013557562 > 3.5657721966142724. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -110.96557176177348 (T) = (0 -104.14416785764574) / Math.Sqrt((0.37555703796618034 / (33)) + (3.243934345538485 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -28.621557900862957 = (3.515823448793412 - 104.14416785764574) / 3.515823448793412 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 178.84148357878848 > 3.5359557451320507. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -347.85303488220313 (T) = (0 -178.83844981254393) / Math.Sqrt((0.4048747887488895 / (31)) + (0.9634865350732391 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -49.384520072780006 = (3.5494721306110155 - 178.83844981254393) / 3.5494721306110155 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 104.90998129943283 > 89.37888521902306. IsChangePoint: Marked as a change because one of 1/28/2023 4:01:39 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.785984562627912 (T) = (0 -105.41588591120893) / Math.Sqrt((27.764411331141275 / (33)) + (39.04158454923819 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.21760339833356473 = (86.57653720044074 - 105.41588591120893) / 86.57653720044074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.79367061123471 > 3.4007659424778627. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.484841600453954 (T) = (0 -50.10026608009978) / Math.Sqrt((0.4118223954663186 / (33)) + (7.351645239129664 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.701194826627315 = (3.19085691460473 - 50.10026608009978) / 3.19085691460473 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 102.89399422735346 > 3.431625590387156. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -92.48009614651156 (T) = (0 -105.84189583352814) / Math.Sqrt((0.6397628041854074 / (33)) + (4.837269542952284 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -30.779099062021896 = (3.330550549182061 - 105.84189583352814) / 3.330550549182061 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 118.02575464611701 > 2.672006994385557. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.41156595603546 (T) = (0 -120.8440926736645) / Math.Sqrt((0.6430285143768347 / (33)) + (24.771503538062344 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -44.2156610424084 = (2.672615856712194 - 120.8440926736645) / 2.672615856712194 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 138.93293956095476 > 110.54252324575596. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.51495817077588 (T) = (0 -142.0286334616382) / Math.Sqrt((26.48470314125636 / (33)) + (5.686866750927572 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4063252194802391 = (100.99273730875016 - 142.0286334616382) / 100.99273730875016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.89418071249683 > 2.649276862522835. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.063505632525647 (T) = (0 -27.73783085495514) / Math.Sqrt((0.5533882143129331 / (32)) + (5.647237065786576 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.845911068207192 = (2.557445905698372 - 27.73783085495514) / 2.557445905698372 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.02548198863542 > 2.616910654776758. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.951839642521668 (T) = (0 -32.56821175986988) / Math.Sqrt((0.7535156429339602 / (33)) + (21.033052798736996 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.614668907091255 = (2.8040585590851914 - 32.56821175986988) / 2.8040585590851914 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.5431916085843 > 107.70939591900891. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.75200147980668 (T) = (0 -126.88052282670964) / Math.Sqrt((10.640468838218014 / (32)) + (6.02734738483483 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.2181192004391165 = (104.16100721585443 - 126.88052282670964) / 104.16100721585443 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).EqualsAnyBenchmark.html>)	1.97 ns	48.59 ns	24.65	0.61	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).ExclusiveOrOperatorBenchmark.html>)	6.61 ns	47.75 ns	7.23	0.59	True
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanAllBenchmark.html>)	2.56 ns	29.76 ns	11.61	0.68	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).DivideBenchmark.html>)	4.23 ns	66.62 ns	15.75	0.59	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).ConditionalSelectBenchmark.html>)	3.62 ns	51.66 ns	14.25	0.66	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AllBitsSetBenchmark.html>)	2.01 ns	31.30 ns	15.54	0.68	True
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanOrEqualAnyBenchmark.html>)	2.73 ns	47.65 ns	17.47	0.62	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanBenchmark.html>)	3.22 ns	53.16 ns	16.51	0.56	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).OnesComplementOperatorBenchmark.html>)	6.17 ns	42.36 ns	6.86	0.62	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).ZeroBenchmark.html>)	1.82 ns	16.50 ns	9.08	0.65	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AddBenchmark.html>)	4.17 ns	56.52 ns	13.54	0.58	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).BitwiseOrBenchmark.html>)	3.38 ns	48.50 ns	14.35	0.59	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).OnesComplementBenchmark.html>)	2.79 ns	43.92 ns	15.73	0.55	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanAllBenchmark.html>)	2.51 ns	26.25 ns	10.47	0.67	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).InequalityOperatorBenchmark.html>)	3.26 ns	38.93 ns	11.94	0.73	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).MultiplyBenchmark.html>)	1.21 ns	60.91 ns	50.23	0.59	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanOrEqualBenchmark.html>)	1.42 ns	53.70 ns	37.76	0.65	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanAnyBenchmark.html>)	2.72 ns	48.26 ns	17.72	0.58	False
[EqualsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).EqualsBenchmark.html>)	7.57 ns	160.80 ns	21.23	0.61	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).XorBenchmark.html>)	3.26 ns	48.94 ns	14.99	0.58	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AndNotBenchmark.html>)	3.48 ns	47.96 ns	13.76	0.59	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).EqualityOperatorBenchmark.html>)	1.96 ns	29.23 ns	14.93	0.74	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).CountBenchmark.html>)	0.03 ns	14.91 ns	491.93	0.90	True
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).NegateBenchmark.html>)	26.30 ns	79.33 ns	3.02	0.55	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanOrEqualAnyBenchmark.html>)	3.09 ns	45.33 ns	14.66	0.62	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).MinBenchmark.html>)	3.13 ns	55.24 ns	17.66	0.57	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanOrEqualBenchmark.html>)	3.07 ns	58.48 ns	19.03	0.57	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).UnaryNegateOperatorBenchmark.html>)	21.63 ns	76.27 ns	3.53	0.56	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanOrEqualAllBenchmark.html>)	2.49 ns	29.54 ns	11.88	0.69	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanAnyBenchmark.html>)	2.27 ns	50.37 ns	22.16	0.60	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AbsBenchmark.html>)	3.16 ns	52.19 ns	16.52	0.62	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).BitwiseOrOperatorBenchmark.html>)	2.00 ns	50.75 ns	25.33	0.63	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).MaxBenchmark.html>)	3.84 ns	57.45 ns	14.95	0.59	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).EqualsStaticBenchmark.html>)	2.96 ns	67.47 ns	22.83	0.60	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).DivisionOperatorBenchmark.html>)	3.52 ns	56.93 ns	16.19	0.60	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AddOperatorBenchmark.html>)	3.44 ns	54.25 ns	15.77	0.57	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).DotBenchmark.html>)	3.12 ns	65.51 ns	20.99	0.63	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).BitwiseAndBenchmark.html>)	3.29 ns	50.54 ns	15.36	0.60	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SubtractBenchmark.html>)	3.18 ns	64.48 ns	20.30	0.63	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).GreaterThanOrEqualAllBenchmark.html>)	3.73 ns	26.21 ns	7.04	0.70	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).BitwiseAndOperatorBenchmark.html>)	4.27 ns	48.43 ns	11.35	0.57	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SumBenchmark.html>)	0.60 ns	30.71 ns	51.55	0.63	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanBenchmark.html>)	3.29 ns	51.06 ns	15.53	0.62	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SquareRootBenchmark.html>)	27.01 ns	52.51 ns	1.94	0.63	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).MultiplyOperatorBenchmark.html>)	3.45 ns	52.56 ns	15.22	0.59	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SubtractionOperatorBenchmark.html>)	3.60 ns	53.73 ns	14.93	0.56	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).EqualsAllBenchmark.html>)	2.31 ns	39.86 ns	17.29	0.73	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.593673989105575 > 2.5667389120916106. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.809478815485235 (T) = (0 -47.768096373683264) / Math.Sqrt((1.06894673514261 / (33)) + (3.429584787067635 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -16.89011520618283 = (2.6700832176404647 - 47.768096373683264) / 2.6700832176404647 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.75302936844212 > 4.813795338081269. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -82.10539313609578 (T) = (0 -48.09632185629754) / Math.Sqrt((0.9553347255725594 / (32)) + (1.0452672966234493 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.683518662463474 = (3.7920330419536725 - 48.09632185629754) / 3.7920330419536725 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.762906783285963 > 2.9367326209709423. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.843188250613096 (T) = (0 -30.209347617193274) / Math.Sqrt((0.6074793170828972 / (32)) + (4.158714065900167 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.663667103929969 = (2.590038565745288 - 30.209347617193274) / 2.590038565745288 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 66.61692472764385 > 3.530180520910687. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.82534997471873 (T) = (0 -65.96263195434263) / Math.Sqrt((2.186682481573939 / (33)) + (4.564076587208047 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.71288267946997 = (3.5249850642579337 - 65.96263195434263) / 3.5249850642579337 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.65938244328553 > 3.7051276030391818. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -161.4515738745115 (T) = (0 -52.168486218080886) / Math.Sqrt((0.395118560494147 / (33)) + (0.3122838723905183 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.019617046323022 = (3.7211063644397697 - 52.168486218080886) / 3.7211063644397697 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.304426438544702 > 2.1090335272490917. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -76.96643915332352 (T) = (0 -30.569404075788647) / Math.Sqrt((0.5286535209426281 / (33)) + (0.48739392935385606 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.351566773706839 = (1.9912888714489991 - 30.569404075788647) / 1.9912888714489991 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.64844046030262 > 2.6101605973062134. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.4371330214226 (T) = (0 -49.28579866334772) / Math.Sqrt((0.7936340935134029 / (33)) + (11.468408855236484 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.715799584659635 = (2.633379270835146 - 49.28579866334772) / 2.633379270835146 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.16384508650322 > 3.405364967856597. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.266590231119764 (T) = (0 -54.672862351697184) / Math.Sqrt((0.33550166393947106 / (33)) + (7.131070379580784 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.922397975206206 = (3.433707814415381 - 54.672862351697184) / 3.433707814415381 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.36253312485161 > 6.499083051387761. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -72.66144372767137 (T) = (0 -43.02898912217728) / Math.Sqrt((1.4563947915601307 / (33)) + (0.8475833726701186 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.870567493580145 = (6.262799857855053 - 43.02898912217728) / 6.262799857855053 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.495309139807834 > 2.039080578345535. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.885900956397855 (T) = (0 -17.214677656799477) / Math.Sqrt((0.2684308749011535 / (33)) + (2.5500185358205596 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.440458267510947 = (2.0395430095380362 - 17.214677656799477) / 2.0395430095380362 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.52387952667996 > 3.785681942098645. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.84393124308411 (T) = (0 -58.97268460166412) / Math.Sqrt((1.6012690162827912 / (33)) + (4.381061627017631 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.722216342143179 = (3.5266069637576503 - 58.97268460166412) / 3.5266069637576503 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.497875983072525 > 3.4874192594873605. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.18168502530155 (T) = (0 -49.940878866220366) / Math.Sqrt((1.0523811073171967 / (32)) + (7.236594897875068 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.072037287878102 = (3.5489444665727476 - 49.940878866220366) / 3.5489444665727476 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.921119523587585 > 3.3759979003838367. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.360121730497557 (T) = (0 -45.603449980843635) / Math.Sqrt((0.7197639380713089 / (33)) + (8.866626493200952 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.374940516282257 = (3.172427039206831 - 45.603449980843635) / 3.172427039206831 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.249851862972815 > 2.6505280535333458. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.695143239793405 (T) = (0 -28.717245363745562) / Math.Sqrt((0.5490269551652749 / (33)) + (23.922945559769484 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.371652436575229 = (2.525336183453938 - 28.717245363745562) / 2.525336183453938 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.93001538507544 > 2.525711191790444. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.799143002378079 (T) = (0 -32.44015507361555) / Math.Sqrt((0.2190075933000478 / (32)) + (21.968019943369736 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.368314475408516 = (2.42664511919512 - 32.44015507361555) / 2.42664511919512 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 60.907450384802104 > 3.340760884519714. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.725611794474915 (T) = (0 -66.23112671514531) / Math.Sqrt((1.7415772855624416 / (32)) + (30.48624155116485 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -19.26327841109053 = (3.2685296708402127 - 66.23112671514531) / 3.2685296708402127 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.69718245964058 > 3.634798318453084. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.291864311836417 (T) = (0 -55.151188341871276) / Math.Sqrt((2.6961967295310663 / (33)) + (10.309782570072427 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.373646600911815 = (4.123870623148593 - 55.151188341871276) / 4.123870623148593 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.25562404857866 > 2.7565075606409333. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.93868160328824 (T) = (0 -47.919730422067055) / Math.Sqrt((0.8306859724388146 / (33)) + (9.70313111820638 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.327040803306584 = (2.61470091851497 - 47.919730422067055) / 2.61470091851497 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 160.79559812631854 > 6.429810537925284. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -93.46140190087151 (T) = (0 -164.50927437440998) / Math.Sqrt((1.7850367718058624 / (33)) + (11.239137568144661 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.928926935217 = (6.344623315320134 - 164.50927437440998) / 6.344623315320134 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.94257332694928 > 3.6839817338126264. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -48.03530403546862 (T) = (0 -49.409034658640934) / Math.Sqrt((0.6540006656221711 / (33)) + (3.595860497893801 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.680317163022917 = (3.3656653401939725 - 49.409034658640934) / 3.3656653401939725 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.96334431869909 > 3.507613350353567. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.760079107698118 (T) = (0 -51.526993871728365) / Math.Sqrt((1.3917123734936652 / (32)) + (36.50532376073227 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -13.971787809467918 = (3.441605940951389 - 51.526993871728365) / 3.441605940951389 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.23397750001302 > 2.4427298966659503. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -118.26274831194172 (T) = (0 -29.239775353146086) / Math.Sqrt((0.7350226688919093 / (31)) + (0.11277049699591278 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -11.730239109534237 = (2.2968755811701236 - 29.239775353146086) / 2.2968755811701236 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.907256324214893 > 0.0895860246800629. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.658726423717145 (T) = (0 -16.180683717696095) / Math.Sqrt((0.19436193003668983 / (33)) + (2.157194226505368 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -84.8125794543819 = (0.18855841207171462 - 16.180683717696095) / 0.18855841207171462 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 79.3261300911382 > 23.313661268569557. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.81101126682045 (T) = (0 -78.49893737963535) / Math.Sqrt((3.04203384108565 / (31)) + (7.0647527782588915 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -2.44662959643532 = (22.775565282913764 - 78.49893737963535) / 22.775565282913764 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.33362248087347 > 2.647105935023806. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.628435168186243 (T) = (0 -49.30775506249323) / Math.Sqrt((0.47008155987294686 / (32)) + (16.95801255268474 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.712382545393016 = (2.6350335101840243 - 49.30775506249323) / 2.6350335101840243 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.24206721725639 > 3.75689328311711. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.86523477999928 (T) = (0 -58.15384915673309) / Math.Sqrt((1.0203625353701937 / (32)) + (6.331778491612312 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.792274797087815 = (3.682423837220524 - 58.15384915673309) / 3.682423837220524 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.4791719244453 > 3.4216585826885417. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.20841715919726 (T) = (0 -58.2086429442681) / Math.Sqrt((1.6624023574752165 / (33)) + (7.952237475647297 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.916865382465886 = (3.6570418575249803 - 58.2086429442681) / 3.6570418575249803 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 76.26664399920539 > 24.171137782645058. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.496817422531315 (T) = (0 -74.8701004846495) / Math.Sqrt((3.0703166209321266 / (32)) + (3.8298420044384525 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -2.2492377907808034 = (23.042358025344136 - 74.8701004846495) / 23.042358025344136 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.54149177498081 > 2.843740093013788. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.712780774905417 (T) = (0 -29.282627684945588) / Math.Sqrt((0.6426582229946876 / (33)) + (11.445965652054873 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.207875069255655 = (2.612683269933194 - 29.282627684945588) / 2.612683269933194 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.36859006175856 > 2.6702897428764025. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.04953899420726 (T) = (0 -48.43955104123343) / Math.Sqrt((0.6481924175654464 / (32)) + (5.123672755360184 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -16.579650077507814 = (2.755433175726811 - 48.43955104123343) / 2.755433175726811 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.18508464429453 > 3.3176906993053943. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.44053553741199 (T) = (0 -50.923650862651904) / Math.Sqrt((0.8782577410582819 / (33)) + (5.123044105408508 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.383842476070887 = (3.540337079425684 - 50.923650862651904) / 3.540337079425684 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.74629551365653 > 3.435505815765374. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.63719175752661 (T) = (0 -55.43765561129768) / Math.Sqrt((1.7196754450524545 / (33)) + (143.69718188013383 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.265817832281192 = (3.631489398102791 - 55.43765561129768) / 3.631489398102791 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.45357486373256 > 3.873861878717057. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.749274960233414 (T) = (0 -55.16588324584463) / Math.Sqrt((2.176281488057676 / (31)) + (12.498995871269441 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -13.601101702189261 = (3.7782000544228223 - 55.16588324584463) / 3.7782000544228223 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 67.47053689201539 > 4.407202449299341. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.990968349926515 (T) = (0 -56.87382101229059) / Math.Sqrt((0.3668934026008066 / (33)) + (50.851009922906606 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.726436695205914 = (3.4002353309710975 - 56.87382101229059) / 3.4002353309710975 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.934745878728094 > 3.578626979588396. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.228886098357506 (T) = (0 -55.15870482532992) / Math.Sqrt((0.9115805464255292 / (32)) + (5.354930188026311 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.02201321582567 = (3.442682519500556 - 55.15870482532992) / 3.442682519500556 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.25213946730136 > 4.243480851116643. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.339488174626965 (T) = (0 -56.096634699725264) / Math.Sqrt((1.1161469253637353 / (32)) + (21.950761267768584 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.588871329346677 = (3.5985052101957566 - 56.096634699725264) / 3.5985052101957566 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.51094417654625 > 2.568035484325827. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.58313950261498 (T) = (0 -66.42018074122066) / Math.Sqrt((0.7431354641172885 / (33)) + (4.970075472721404 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -22.901528918745896 = (2.7789092893186225 - 66.42018074122066) / 2.7789092893186225 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.54311895459263 > 3.4801467702857454. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.976615595541666 (T) = (0 -49.79780850662192) / Math.Sqrt((0.8218913381048485 / (32)) + (3.9722827519153494 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.680720840805536 = (3.3920547258284013 - 49.79780850662192) / 3.3920547258284013 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.4814216539501 > 3.46224613830786. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -53.70986765601377 (T) = (0 -65.61151220901522) / Math.Sqrt((2.601610567538896 / (32)) + (5.003406560536267 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.12382483232502 = (3.620180222222895 - 65.61151220901522) / 3.620180222222895 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.206713998667116 > 2.8181712127930525. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.76483636666984 (T) = (0 -27.15100829967409) / Math.Sqrt((1.3462886275129295 / (33)) + (1.6032655450463231 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.984502778879024 = (2.719315012572151 - 27.15100829967409) / 2.719315012572151 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.4251333238978 > 3.688364666995504. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -192.67595331838857 (T) = (0 -48.74685996537734) / Math.Sqrt((0.3320597705210496 / (33)) + (0.180995673531354 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.201017283794366 = (3.432631549642948 - 48.74685996537734) / 3.432631549642948 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.707430310081083 > 2.135408745310967. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.133124985373582 (T) = (0 -34.85880536679131) / Math.Sqrt((1.9456733326347138 / (33)) + (28.583214887920363 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.212575047336642 = (2.2914467312944664 - 34.85880536679131) / 2.2914467312944664 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.06391783653785 > 3.4849303229155004. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.14237273590835 (T) = (0 -57.87283125862245) / Math.Sqrt((0.9820747176079019 / (33)) + (40.48606802798475 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -16.77748651285967 = (3.2554000936386074 - 57.87283125862245) / 3.2554000936386074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.50902127581299 > 29.543401713012404. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.805875830378904 (T) = (0 -48.984499474862204) / Math.Sqrt((7.329950276909714 / (32)) + (7.397244995763205 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.6844057919606039 = (29.081174921540455 - 48.984499474862204) / 29.081174921540455 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.55918382210463 > 3.5569534487847125. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.65864069400944 (T) = (0 -55.30194417421441) / Math.Sqrt((0.9750581540468813 / (31)) + (5.009347257886742 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -14.496543826690319 = (3.5686631027342792 - 55.30194417421441) / 3.5686631027342792 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.73025975130286 > 3.482842679733346. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -67.10047252681575 (T) = (0 -53.18285125228029) / Math.Sqrt((0.6975819870252014 / (32)) + (2.1271180489839527 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.32295621391087 = (3.2581629550017666 - 53.18285125228029) / 3.2581629550017666 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.86353563910237 > 2.515732218966597. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.0311188843804 (T) = (0 -38.045265932773546) / Math.Sqrt((0.40917675089682776 / (32)) + (4.893876796181523 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.651269109461321 = (2.4308102855234193 - 38.045265932773546) / 2.4308102855234193 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualBenchmark.html>)	3.32 ns	109.68 ns	33.00	0.43	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseAndBenchmark.html>)	3.24 ns	51.96 ns	16.06	0.59	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).ZeroBenchmark.html>)	1.94 ns	16.49 ns	8.49	0.60	True
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).InequalityOperatorBenchmark.html>)	2.55 ns	17.58 ns	6.88	0.69	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).SquareRootBenchmark.html>)	104.92 ns	125.56 ns	1.20	0.21	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).DotBenchmark.html>)	18.44 ns	162.90 ns	8.83	0.33	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).OneBenchmark.html>)	2.25 ns	28.67 ns	12.73	0.75	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).ExclusiveOrOperatorBenchmark.html>)	2.98 ns	52.56 ns	17.65	0.56	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).EqualityOperatorBenchmark.html>)	2.09 ns	17.15 ns	8.21	0.63	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualBenchmark.html>)	3.54 ns	163.67 ns	46.18	0.46	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).SubtractionOperatorBenchmark.html>)	3.49 ns	98.95 ns	28.36	0.45	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualAnyBenchmark.html>)	4.00 ns	23.14 ns	5.79	0.64	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).ConditionalSelectBenchmark.html>)	4.20 ns	175.48 ns	41.75	0.58	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualAllBenchmark.html>)	2.41 ns	18.63 ns	7.72	0.67	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsStaticBenchmark.html>)	3.33 ns	115.15 ns	34.62	0.48	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanAllBenchmark.html>)	2.62 ns	100.56 ns	38.41	0.50	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).DivideBenchmark.html>)	100.19 ns	125.50 ns	1.25	0.14	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).CountBenchmark.html>)	0.00 ns	14.84 ns	20542.44	0.92	True
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).AddBenchmark.html>)	3.35 ns	105.10 ns	31.37	0.43	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanOrEqualAnyBenchmark.html>)	2.33 ns	100.50 ns	43.16	0.51	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanBenchmark.html>)	3.24 ns	112.59 ns	34.77	0.47	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanOrEqualAllBenchmark.html>)	0.00 ns	109.04 ns	∞	0.49	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).AndNotBenchmark.html>)	3.27 ns	95.02 ns	29.09	0.54	True
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseOrOperatorBenchmark.html>)	3.25 ns	52.36 ns	16.13	0.63	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementOperatorBenchmark.html>)	4.89 ns	39.46 ns	8.06	0.64	True
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseAndOperatorBenchmark.html>)	4.83 ns	52.31 ns	10.83	0.58	True
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseOrBenchmark.html>)	5.69 ns	50.98 ns	8.96	0.55	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).MinBenchmark.html>)	3.23 ns	125.35 ns	38.76	0.41	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanAnyBenchmark.html>)	2.44 ns	103.79 ns	42.46	0.51	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsAllBenchmark.html>)	1.77 ns	29.26 ns	16.52	0.69	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).EqualsAnyBenchmark.html>)	2.72 ns	102.69 ns	37.72	0.54	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).AbsBenchmark.html>)	4.62 ns	18.99 ns	4.11	0.53	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).XorBenchmark.html>)	3.24 ns	55.91 ns	17.26	0.64	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementBenchmark.html>)	2.96 ns	40.68 ns	13.74	0.61	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).SubtractBenchmark.html>)	3.58 ns	101.85 ns	28.43	0.50	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanAnyBenchmark.html>)	2.35 ns	19.14 ns	8.14	0.70	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyBenchmark.html>)	17.99 ns	105.35 ns	5.86	0.34	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).LessThanBenchmark.html>)	3.84 ns	166.97 ns	43.52	0.50	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).MaxBenchmark.html>)	3.25 ns	117.68 ns	36.25	0.42	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).GreaterThanAllBenchmark.html>)	2.43 ns	25.73 ns	10.60	0.66	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 109.67850358666468 > 3.45656307030226. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -71.6528973056079 (T) = (0 -113.08695130912093) / Math.Sqrt((1.7833910219740394 / (32)) + (9.14476162666844 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -31.93055022677413 = (3.4341045178521123 - 113.08695130912093) / 3.4341045178521123 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.96110953043813 > 3.5250651039434993. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -117.92041272796689 (T) = (0 -52.821482720450234) / Math.Sqrt((0.9613096199578618 / (33)) + (0.5873268814534988 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.73758604322943 = (3.3563904003673364 - 52.821482720450234) / 3.3563904003673364 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.48822165965174 > 2.1378995667809404. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.213833027678124 (T) = (0 -17.607169993132118) / Math.Sqrt((0.3066665618092027 / (33)) + (14.303059588961773 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.568407587550608 = (2.054894076084137 - 17.607169993132118) / 2.054894076084137 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.575756192457284 > 2.3380790686776662. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.34994527246864 (T) = (0 -18.158194329306383) / Math.Sqrt((1.9066287031744344 / (32)) + (2.023461998340163 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.358360903785192 = (2.8557979963824702 - 18.158194329306383) / 2.8557979963824702 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 125.55989955125625 > 110.27066195940438. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.62910855398274 (T) = (0 -124.87215501972672) / Math.Sqrt((9.114201495413802 / (33)) + (1.3042417809352116 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1721247783471189 = (106.53486499604264 - 124.87215501972672) / 106.53486499604264 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 162.90060430892385 > 19.6569965995268. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -151.92496524540482 (T) = (0 -161.12459113286167) / Math.Sqrt((1.412874133481563 / (33)) + (3.3208243243262614 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.403879532793108 = (19.1726440751716 - 161.12459113286167) / 19.1726440751716 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.67010520466102 > 2.1617159844974685. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.078835463527765 (T) = (0 -28.683794523745824) / Math.Sqrt((0.16386187507286967 / (32)) + (19.480219453842825 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.242429828824225 = (2.0139677617154037 - 28.683794523745824) / 2.0139677617154037 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.55954993056796 > 3.7031318305368073. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -80.65378574563688 (T) = (0 -53.609610775394195) / Math.Sqrt((1.180366494938638 / (33)) + (1.3916041089015276 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.680378071646373 = (3.651786794165444 - 53.609610775394195) / 3.651786794165444 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.146574824685537 > 2.715382713565267. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.061333533727737 (T) = (0 -19.764680187673196) / Math.Sqrt((1.2164968935588159 / (33)) + (3.1313472035759453 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.883600326052667 = (2.507062683322178 - 19.764680187673196) / 2.507062683322178 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 163.67210717589168 > 3.38440546301128. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -515.6890216848489 (T) = (0 -164.44911207073457) / Math.Sqrt((0.5492780427935948 / (32)) + (0.3216152743076256 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -47.81969584362361 = (3.368499316290055 - 164.44911207073457) / 3.368499316290055 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 98.94759024247737 > 3.6077401621280294. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -103.54894180191836 (T) = (0 -96.37496624499079) / Math.Sqrt((0.7786193099128191 / (33)) + (3.124790455621122 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -26.68603686124757 = (3.4809953742381894 - 96.37496624499079) / 3.4809953742381894 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.139746695569418 > 2.7512790757110843. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.16071301048978 (T) = (0 -20.996485364346956) / Math.Sqrt((0.8506811232457475 / (33)) + (3.1744419908952133 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.643453611737929 = (2.7469893101860383 - 20.996485364346956) / 2.7469893101860383 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 175.4767400971719 > 3.8349528577454435. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -84.1361251372031 (T) = (0 -178.82539577593428) / Math.Sqrt((2.2512882270299 / (32)) + (16.960318576018707 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -42.13724059468247 = (4.145499186101814 - 178.82539577593428) / 4.145499186101814 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.625465492561695 > 2.5579694213353354. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.987921651138578 (T) = (0 -20.074968838362388) / Math.Sqrt((0.8595836465771113 / (32)) + (3.2586012121976524 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.556660220489974 = (2.656592760903669 - 20.074968838362388) / 2.656592760903669 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 115.15416979245167 > 3.545284186036821. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -74.07945311382167 (T) = (0 -110.88320703023619) / Math.Sqrt((0.5633303365439786 / (32)) + (8.33824447596274 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -30.894583531468996 = (3.4765529050044677 - 110.88320703023619) / 3.4765529050044677 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 100.56283529339255 > 2.528463438275847. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.26035970782992 (T) = (0 -105.79930915253863) / Math.Sqrt((1.5296521696759808 / (32)) + (32.53898657251543 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -39.37278249498578 = (2.6205602540691544 - 105.79930915253863) / 2.6205602540691544 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 125.5013989355446 > 107.88212266775649. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.62104544027754 (T) = (0 -123.65458166169643) / Math.Sqrt((3.793624851545925 / (33)) + (2.6601825818065383 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.20294765649798122 = (102.79298604037302 - 123.65458166169643) / 102.79298604037302 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.841426174705287 > 0.14659967626298187. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.081574281294879 (T) = (0 -16.53490683505181) / Math.Sqrt((0.1584864371474664 / (32)) + (10.495408928152461 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -86.46042597909734 = (0.18905586898243074 - 16.53490683505181) / 0.18905586898243074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 105.10241411196672 > 3.5346361680668434. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -69.47308773270822 (T) = (0 -106.62347921793062) / Math.Sqrt((0.736623582339767 / (32)) + (8.726586861273823 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -29.735943845772972 = (3.4690159427980034 - 106.62347921793062) / 3.4690159427980034 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 100.50109368521883 > 2.4530040351387066. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -49.30934198428594 (T) = (0 -103.90447626803196) / Math.Sqrt((1.0170776944039706 / (33)) + (16.74346635163273 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.21152810809174 = (2.6498451165077164 - 103.90447626803196) / 2.6498451165077164 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 112.5905581882506 > 3.5233931832075904. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.234669587472894 (T) = (0 -113.69929279767857) / Math.Sqrt((0.6528545912958681 / (32)) + (18.49217381332899 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -33.50166276108555 = (3.295472846773057 - 113.69929279767857) / 3.295472846773057 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 109.04006790553262 > 2.551245988570502. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.279322220852535 (T) = (0 -103.33602951313735) / Math.Sqrt((0.283116389331777 / (33)) + (16.12081410387022 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -44.10387489727844 = (2.291067668764145 - 103.33602951313735) / 2.291067668764145 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 95.01798076322778 > 3.445319047597679. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.259937367731567 (T) = (0 -90.84687984650262) / Math.Sqrt((0.11793465884621063 / (33)) + (35.74984342953872 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -26.077297134681885 = (3.35509409948239 - 90.84687984650262) / 3.35509409948239 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.360492844925965 > 3.496594619707285. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -82.90723389553274 (T) = (0 -53.07377666044345) / Math.Sqrt((0.359885755390835 / (33)) + (1.384848836015128 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.03948140915024 = (3.5289632146592895 - 53.07377666044345) / 3.5289632146592895 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.45526841696282 > 4.958034928466887. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -95.18107290747318 (T) = (0 -40.1509658009612) / Math.Sqrt((2.0779005540693958 / (33)) + (0.29833976826450137 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.278115691651142 = (4.8502542482530515 - 40.1509658009612) / 4.8502542482530515 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.305197625538916 > 3.557740434946888. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.26985962540226 (T) = (0 -53.86502060114606) / Math.Sqrt((0.1646029045499356 / (32)) + (3.4479184967582834 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.179481421421045 = (3.329217989016059 - 53.86502060114606) / 3.329217989016059 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.98375971818799 > 4.331058861420518. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -83.18259795355077 (T) = (0 -52.30215841156399) / Math.Sqrt((1.1831716294014145 / (32)) + (1.2046986662190704 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.305015689091409 = (3.9310106529559206 - 52.30215841156399) / 3.9310106529559206 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 125.35297486124438 > 3.580614411647085. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -57.251398501773615 (T) = (0 -119.78469935493551) / Math.Sqrt((0.28774980286574514 / (33)) + (16.48121008484058 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -33.72138238521054 = (3.449882784792503 - 119.78469935493551) / 3.449882784792503 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 103.78934456535966 > 2.6169699447995924. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -75.6142487763715 (T) = (0 -103.98050773722203) / Math.Sqrt((0.3662340491219135 / (33)) + (7.15363454040817 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -39.820670271378525 = (2.5472513568726995 - 103.98050773722203) / 2.5472513568726995 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.258732410826592 > 2.3065750431989662. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.869575516825817 (T) = (0 -28.293433261934354) / Math.Sqrt((0.19125370712245063 / (31)) + (12.182571137759233 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -11.210592149065636 = (2.3171221277830814 - 28.293433261934354) / 2.3171221277830814 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 102.69361389325586 > 2.723375180795346. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -110.43079412926461 (T) = (0 -102.48806821952066) / Math.Sqrt((0.49375613829266357 / (32)) + (3.2184678243406384 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -40.2281620057032 = (2.4858752666525183 - 102.48806821952066) / 2.4858752666525183 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.988981519999147 > 4.55075296027141. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.922269055578223 (T) = (0 -17.636756346422533) / Math.Sqrt((0.9696072610059119 / (33)) + (6.835140802479433 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -2.8717177807179883 = (4.555279425132039 - 17.636756346422533) / 4.555279425132039 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.9054613286563 > 3.4769168743308274. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.22278981152971 (T) = (0 -55.383363024547265) / Math.Sqrt((0.9244668469897731 / (33)) + (10.218346670677896 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.385046316244088 = (3.599817763698996 - 55.383363024547265) / 3.599817763698996 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.68180682496595 > 3.3669112868398825. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.21690903132028 (T) = (0 -40.424474739740425) / Math.Sqrt((1.0315315159531164 / (33)) + (1.9016597845134864 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.415544357737364 = (3.255956692269228 - 40.424474739740425) / 3.255956692269228 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 101.85203273756642 > 3.8629537413821544. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.44452685319235 (T) = (0 -106.02671807124364) / Math.Sqrt((1.0198397953161558 / (33)) + (39.688580498444814 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -27.895999581558883 = (3.669252478080348 - 106.02671807124364) / 3.669252478080348 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.13919364805427 > 2.4957532468407906. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.001136501875965 (T) = (0 -20.630199088359454) / Math.Sqrt((1.2804107501195574 / (32)) + (2.150619477408106 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.638148566991503 = (2.388266296691462 - 20.630199088359454) / 2.388266296691462 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 105.35170975770127 > 17.048648190644553. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -87.63196073808885 (T) = (0 -103.09280402574483) / Math.Sqrt((1.6486523767791603 / (32)) + (3.6839035171142527 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.182718560641635 = (16.674348511028775 - 103.09280402574483) / 16.674348511028775 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 166.9711036781652 > 3.585623364103481. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.771473964952126 (T) = (0 -168.9134630983333) / Math.Sqrt((1.0303357861722544 / (33)) + (108.01332683851281 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -44.42593658482217 = (3.7184365540362045 - 168.9134630983333) / 3.7184365540362045 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 117.67936001457261 > 3.612969332842673. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -96.50950532419427 (T) = (0 -120.49151403313687) / Math.Sqrt((0.43854368406545907 / (33)) + (5.85064997440904 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -36.15067023744639 = (3.243320060257923 - 120.49151403313687) / 3.243320060257923 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.726154577336835 > 2.66691829486575. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.463311483371355 (T) = (0 -22.195873806150715) / Math.Sqrt((1.2575172059942836 / (31)) + (6.201381313872474 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.245741124683963 = (2.69179852611507 - 22.195873806150715) / 2.69179852611507 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).OneBenchmark.html>)	2.07 ns	28.70 ns	13.84	0.68	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanBenchmark.html>)	3.32 ns	56.51 ns	17.03	0.56	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AndNotBenchmark.html>)	3.10 ns	85.48 ns	27.60	0.63	True
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsAllBenchmark.html>)	2.18 ns	30.42 ns	13.98	0.68	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).OnesComplementOperatorBenchmark.html>)	5.25 ns	39.40 ns	7.50	0.66	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).SubtractBenchmark.html>)	3.53 ns	43.30 ns	12.27	0.57	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).MinBenchmark.html>)	3.48 ns	34.95 ns	10.05	0.57	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualAllBenchmark.html>)	2.36 ns	31.33 ns	13.26	0.61	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).ExclusiveOrOperatorBenchmark.html>)	3.32 ns	52.24 ns	15.72	0.61	True
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).DivideBenchmark.html>)	32.05 ns	48.51 ns	1.51	0.42	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).DivisionOperatorBenchmark.html>)	27.10 ns	39.22 ns	1.45	0.36	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanAllBenchmark.html>)	2.00 ns	31.51 ns	15.79	0.63	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AddOperatorBenchmark.html>)	3.55 ns	28.82 ns	8.11	0.54	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualBenchmark.html>)	3.80 ns	52.81 ns	13.89	0.51	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AbsBenchmark.html>)	3.84 ns	31.57 ns	8.21	0.57	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).ConditionalSelectBenchmark.html>)	3.45 ns	177.40 ns	51.47	0.52	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).ZeroBenchmark.html>)	1.94 ns	18.57 ns	9.58	0.67	True
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualAnyBenchmark.html>)	2.41 ns	34.49 ns	14.30	0.60	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsAnyBenchmark.html>)	2.42 ns	33.35 ns	13.76	0.66	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanAnyBenchmark.html>)	2.65 ns	21.16 ns	7.98	0.68	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).DotBenchmark.html>)	2.61 ns	47.36 ns	18.12	0.65	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanAllBenchmark.html>)	2.27 ns	18.30 ns	8.05	0.72	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).InequalityOperatorBenchmark.html>)	2.38 ns	17.47 ns	7.33	0.63	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).CountBenchmark.html>)	0.00 ns	14.81 ns	∞	0.90	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).OnesComplementBenchmark.html>)	3.34 ns	56.75 ns	17.00	0.60	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).LessThanOrEqualAnyBenchmark.html>)	2.42 ns	21.33 ns	8.83	0.67	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AddBenchmark.html>)	3.24 ns	44.10 ns	13.60	0.61	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseAndBenchmark.html>)	3.30 ns	52.11 ns	15.78	0.60	True
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseOrBenchmark.html>)	3.11 ns	52.23 ns	16.80	0.62	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanAnyBenchmark.html>)	2.51 ns	35.21 ns	14.04	0.57	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanBenchmark.html>)	4.35 ns	40.37 ns	9.29	0.61	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).SquareRootBenchmark.html>)	23.79 ns	37.86 ns	1.59	0.55	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).EqualsStaticBenchmark.html>)	1.74 ns	42.75 ns	24.64	0.57	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseOrOperatorBenchmark.html>)	2.35 ns	52.47 ns	22.28	0.64	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).MaxBenchmark.html>)	3.29 ns	37.15 ns	11.28	0.57	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualBenchmark.html>)	3.40 ns	43.14 ns	12.70	0.58	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).MultiplyBenchmark.html>)	3.07 ns	41.28 ns	13.47	0.52	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).MultiplyOperatorBenchmark.html>)	4.51 ns	31.01 ns	6.88	0.57	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).EqualityOperatorBenchmark.html>)	2.48 ns	17.41 ns	7.03	0.64	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseAndOperatorBenchmark.html>)	3.33 ns	51.90 ns	15.57	0.63	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).GreaterThanOrEqualAllBenchmark.html>)	2.72 ns	21.29 ns	7.84	0.66	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).SubtractionOperatorBenchmark.html>)	5.77 ns	31.22 ns	5.41	0.55	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).XorBenchmark.html>)	3.94 ns	53.51 ns	13.59	0.62	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int32>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.695887534528172 > 2.1670346030585597. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.247142487253294 (T) = (0 -24.506695904229044) / Math.Sqrt((0.3234250397422224 / (33)) + (8.710783132695678 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.529716703261608 = (1.9558858739279965 - 24.506695904229044) / 1.9558858739279965 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.50921356564033 > 3.655978395529811. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -58.90738163561715 (T) = (0 -54.15701478298398) / Math.Sqrt((2.3420656702460247 / (32)) + (2.6343692014094198 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.383807600735578 = (3.7651375968220284 - 54.15701478298398) / 3.7651375968220284 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.47960054835097 > 3.4643167126749366. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.036383177401014 (T) = (0 -98.17996968947588) / Math.Sqrt((0.7920577055148049 / (33)) + (99.4928596666461 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -29.739668765924666 = (3.1939176195128587 - 98.17996968947588) / 3.1939176195128587 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.4164556147858 > 2.29219149061431. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.205318972310423 (T) = (0 -26.679323255939813) / Math.Sqrt((0.26196866055393353 / (33)) + (6.408504742209357 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.549409349321465 = (2.310016248364012 - 26.679323255939813) / 2.310016248364012 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.39610194429537 > 4.74660892134944. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -193.9838021349508 (T) = (0 -39.41279096043045) / Math.Sqrt((1.0094882490806536 / (32)) + (0.001086963669963645 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -7.277595173171116 = (4.761381794578818 - 39.41279096043045) / 4.761381794578818 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.30126908344128 > 3.495288262611652. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.321167844948977 (T) = (0 -42.23960352830656) / Math.Sqrt((0.6965420515408184 / (32)) + (6.035546005528585 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.10586073435304 = (3.489186308615165 - 42.23960352830656) / 3.489186308615165 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.95155930764997 > 3.5799046213684513. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.02492513726898 (T) = (0 -39.28424698037958) / Math.Sqrt((0.6088049905476745 / (32)) + (35.14900253836142 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.912785460773781 = (3.5998368264076634 - 39.28424698037958) / 3.5998368264076634 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.331792528056962 > 2.5502577938562405. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.743586560943065 (T) = (0 -33.06870933495945) / Math.Sqrt((0.8992489754291715 / (31)) + (6.5013257613584585 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -12.073528119630167 = (2.5294403341134912 - 33.06870933495945) / 2.5294403341134912 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.24288442085479 > 3.468845024395796. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.2123887101519 (T) = (0 -53.99021303157983) / Math.Sqrt((0.5202299538174529 / (32)) + (5.679861183167968 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.870927132950573 = (3.4018310700631686 - 53.99021303157983) / 3.4018310700631686 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.51078645603434 > 29.86294632473362. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.806487123611651 (T) = (0 -47.817998474291606) / Math.Sqrt((4.6567273417267705 / (33)) + (7.30152954192198 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.6803647937620744 = (28.456915219721175 - 47.817998474291606) / 28.456915219721175 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.218205255632014 > 28.275467881709957. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.836520299340677 (T) = (0 -40.68678793605115) / Math.Sqrt((1.4534052204381422 / (33)) + (4.157814077249575 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4889889713780327 = (27.325110338726184 - 40.68678793605115) / 27.325110338726184 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.510081445499768 > 2.3023061398767775. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.684720769994405 (T) = (0 -34.97167569007768) / Math.Sqrt((0.6362748063983859 / (31)) + (45.33779481076732 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -13.964763609039808 = (2.336934722373579 - 34.97167569007768) / 2.336934722373579 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.822516632626176 > 3.8572703246238396. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.77493392383194 (T) = (0 -32.328565945477735) / Math.Sqrt((1.2594055481522222 / (31)) + (9.152053248702186 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.7891337825744635 = (3.6782425600999593 - 32.328565945477735) / 3.6782425600999593 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.812259473679816 > 3.6147449781887757. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.87335367339724 (T) = (0 -57.02620396726523) / Math.Sqrt((1.6965458344154911 / (32)) + (28.834461229009392 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.421519733757355 = (3.47265081988957 - 57.02620396726523) / 3.47265081988957 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.569764972467507 > 3.5182080634834385. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.76723147394594 (T) = (0 -33.43325540227763) / Math.Sqrt((0.6098037467250608 / (33)) + (12.841159381439136 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.117203779020233 = (3.3045944445250033 - 33.43325540227763) / 3.3045944445250033 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 177.3988717323603 > 3.5958629460099694. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -85.40125183713656 (T) = (0 -180.1103101004053) / Math.Sqrt((0.2743422149263637 / (33)) + (17.08287250938857 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -51.193526842751986 = (3.4508170073089603 - 180.1103101004053) / 3.4508170073089603 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.56519885547705 > 2.053884198200501. IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.605448333787066 (T) = (0 -17.010526294557124) / Math.Sqrt((0.4521521317614348 / (33)) + (1.1160980225751953 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.198521567922364 = (2.0748285106808426 - 17.010526294557124) / 2.0748285106808426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.48670390804526 > 2.5313077006529174. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.59828274795263 (T) = (0 -33.99334983036347) / Math.Sqrt((0.9635080785942549 / (33)) + (6.896976181315602 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.38338449843484 = (2.7450774733401806 - 33.99334983036347) / 2.7450774733401806 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.35438430460295 > 2.7074744344557646. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.734249562403361 (T) = (0 -33.83703748051217) / Math.Sqrt((0.24051098250254366 / (33)) + (15.91533982858551 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.963948571684762 = (2.4231711615670686 - 33.83703748051217) / 2.4231711615670686 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.155263346202894 > 2.6159817565749353. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.844479033398255 (T) = (0 -21.09088665826726) / Math.Sqrt((0.2074747514717953 / (31)) + (4.3821889468740265 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.950494824686657 = (2.3563933694588353 - 21.09088665826726) / 2.3563933694588353 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.364312751555076 > 2.813660887099008. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -76.69101246786374 (T) = (0 -47.931611073711835) / Math.Sqrt((0.8238900329529204 / (33)) + (1.28250532831418 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.834862311471849 = (2.847163831037074 - 47.931611073711835) / 2.847163831037074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.295583537681274 > 2.344169215083434. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.716073728222195 (T) = (0 -20.320122674391314) / Math.Sqrt((1.3223951925550748 / (33)) + (9.376970929089971 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.115981725031142 = (2.2290657536746976 - 20.320122674391314) / 2.2290657536746976 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.469179287989807 > 2.6098454025682165. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -75.28483330514815 (T) = (0 -17.951665991715174) / Math.Sqrt((0.3596507911555479 / (33)) + (0.12066992979398845 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.660146446745054 = (2.6953860752549232 - 17.951665991715174) / 2.6953860752549232 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.811792993271204 > 0.022686304657970585. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -167.23057060047717 (T) = (0 -14.88020285613635) / Math.Sqrt((0.21643223311927007 / (32)) + (0.003803991441941676 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -76.51534262674359 = (0.1919646143833534 - 14.88020285613635) / 0.1919646143833534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.75293108017324 > 3.45539208507899. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.355074845870073 (T) = (0 -48.09972399618374) / Math.Sqrt((0.05289607288092997 / (32)) + (56.26170841841066 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -13.78039572498716 = (3.254292029195688 - 48.09972399618374) / 3.254292029195688 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.332298918067426 > 2.5297083613505764. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.807438906328162 (T) = (0 -21.619136335700432) / Math.Sqrt((0.27441738416024225 / (33)) + (2.179978304217638 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.924980616576816 = (2.4223174552946505 - 21.619136335700432) / 2.4223174552946505 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.10216331990934 > 3.709733212324379. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.47384374322005 (T) = (0 -43.234352889393776) / Math.Sqrt((1.1169404891032295 / (33)) + (6.660089749847131 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.30156911604265 = (3.514539688519186 - 43.234352889393776) / 3.514539688519186 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.1129703413353 > 3.545873994109354. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -268.32250528329394 (T) = (0 -52.22933107140901) / Math.Sqrt((1.0066312287769246 / (33)) + (0.011318529294766982 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.118345153212001 = (3.240365594293093 - 52.22933107140901) / 3.240365594293093 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.22576925224772 > 3.4810096243465236. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -200.36705813320916 (T) = (0 -51.997792974990894) / Math.Sqrt((0.9212866238741209 / (32)) + (0.12152648905746892 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.960111261680991 = (3.2579843663016077 - 51.997792974990894) / 3.2579843663016077 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.21411248769094 > 2.8087273564046873. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.31157365155635 (T) = (0 -34.23224767890139) / Math.Sqrt((0.7227700549905974 / (32)) + (4.530902027109785 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.555047453825024 = (2.7265725442138558 - 34.23224767890139) / 2.7265725442138558 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.36796639762462 > 3.4720118753497116. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.62249090679286 (T) = (0 -42.974926940902186) / Math.Sqrt((0.4652117942533275 / (33)) + (29.177969087348327 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.478580960813831 = (3.4438953496279145 - 42.974926940902186) / 3.4438953496279145 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.85645544304564 > 25.093264121873375. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.4598504624546855 (T) = (0 -39.438237185511404) / Math.Sqrt((3.212956285438237 / (32)) + (28.302076208517224 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.5894544559962569 = (24.812436139160617 - 39.438237185511404) / 24.812436139160617 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.747927482810034 > 3.4969935701700288. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.62046635978088 (T) = (0 -40.80022725579241) / Math.Sqrt((0.32071033707495067 / (33)) + (2.0682144538237366 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.235514231898984 = (3.334573969063179 - 40.80022725579241) / 3.334573969063179 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.46540868471908 > 3.3503819593316146. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.28274180987781 (T) = (0 -55.37726716389487) / Math.Sqrt((0.6249837251304624 / (31)) + (9.152951356328218 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -15.831614053209297 = (3.2900746766669147 - 55.37726716389487) / 3.2900746766669147 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.145517724224874 > 3.448370146341066. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.50675917094509 (T) = (0 -37.05821988012299) / Math.Sqrt((0.7546076047065626 / (33)) + (1.3172701077515034 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.515323191328651 = (3.5242112111858486 - 37.05821988012299) / 3.5242112111858486 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.13504952663004 > 3.5262128248781517. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.05848824674424 (T) = (0 -42.25532437433677) / Math.Sqrt((0.3696565115362354 / (32)) + (10.418245882395292 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.643136908578354 = (3.3421550901395825 - 42.25532437433677) / 3.3421550901395825 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.27605572788689 > 3.4098568915064185. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.820606810406195 (T) = (0 -42.80198076668803) / Math.Sqrt((0.9440432712737858 / (33)) + (37.613996869242555 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.487183076014599 = (3.4276730393183827 - 42.80198076668803) / 3.4276730393183827 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.013624121124316 > 3.4500096903941824. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -53.41501065894802 (T) = (0 -31.791865584613376) / Math.Sqrt((0.7325938531534281 / (33)) + (1.022677001268391 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.7459041107617335 = (3.635057643210821 - 31.791865584613376) / 3.635057643210821 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.41157201474478 > 2.4822820474434035. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -93.96886824026868 (T) = (0 -17.448750471638956) / Math.Sqrt((0.74796606017106 / (33)) + (0.011780251596629163 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.238374939836579 = (2.4105894785318895 - 17.448750471638956) / 2.4105894785318895 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.90210419309581 > 3.542166764909358. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -233.37566371691761 (T) = (0 -52.00206958991781) / Math.Sqrt((1.2678809494741823 / (32)) + (0.013815926218243816 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.583033291907219 = (3.565929566846432 - 52.00206958991781) / 3.565929566846432 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.291953734286192 > 2.796344198984324. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.315463880690654 (T) = (0 -20.28379897500379) / Math.Sqrt((0.35266551658484824 / (33)) + (4.212188964610152 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.364228766849715 = (2.425065064623219 - 20.28379897500379) / 2.425065064623219 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.22498655441531 > 3.4512524759466343. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.712933893071188 (T) = (0 -34.07596740539664) / Math.Sqrt((0.33814239397306106 / (32)) + (13.39310159824467 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.888753483348497 = (3.4459315284556924 - 34.07596740539664) / 3.4459315284556924 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int32>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.51308218670004 > 3.4836302316122647. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.969535340188557 (T) = (0 -57.56294765946332) / Math.Sqrt((0.44523333212022537 / (33)) + (26.624343251446685 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.890434898723674 = (3.4080204568215744 - 57.56294765946332) / 3.4080204568215744 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractBenchmark.html>)	3.28 ns	38.68 ns	11.80	0.55	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).ZeroBenchmark.html>)	0.26 ns	16.49 ns	62.61	0.68	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanAllBenchmark.html>)	2.52 ns	20.01 ns	7.92	0.68	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanAllBenchmark.html>)	2.28 ns	32.73 ns	14.34	0.62	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).DivideBenchmark.html>)	23.42 ns	45.38 ns	1.94	0.46	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseAndOperatorBenchmark.html>)	3.49 ns	61.79 ns	17.72	0.63	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).MaxBenchmark.html>)	2.41 ns	41.17 ns	17.09	0.56	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractionOperatorBenchmark.html>)	3.30 ns	32.01 ns	9.71	0.54	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanAnyBenchmark.html>)	2.46 ns	33.90 ns	13.80	0.59	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsStaticBenchmark.html>)	3.19 ns	41.36 ns	12.95	0.56	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsAnyBenchmark.html>)	2.79 ns	31.48 ns	11.26	0.59	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).AndNotBenchmark.html>)	4.05 ns	85.40 ns	21.11	0.58	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualityOperatorBenchmark.html>)	2.35 ns	18.03 ns	7.66	0.71	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanBenchmark.html>)	3.18 ns	40.16 ns	12.64	0.60	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).InequalityOperatorBenchmark.html>)	2.67 ns	22.83 ns	8.54	0.66	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanAnyBenchmark.html>)	2.74 ns	19.71 ns	7.20	0.71	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).AddBenchmark.html>)	3.27 ns	38.85 ns	11.87	0.54	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanOrEqualAnyBenchmark.html>)	2.71 ns	17.93 ns	6.62	0.68	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementBenchmark.html>)	3.24 ns	40.48 ns	12.48	0.67	True
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseOrBenchmark.html>)	3.52 ns	53.05 ns	15.06	0.59	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualAllBenchmark.html>)	2.41 ns	22.10 ns	9.17	0.70	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseAndBenchmark.html>)	3.46 ns	52.15 ns	15.09	0.59	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementOperatorBenchmark.html>)	4.47 ns	39.59 ns	8.86	0.66	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualBenchmark.html>)	3.11 ns	38.95 ns	12.54	0.61	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).AddOperatorBenchmark.html>)	3.39 ns	36.09 ns	10.65	0.58	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).GreaterThanOrEqualAnyBenchmark.html>)	2.49 ns	36.58 ns	14.71	0.64	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseOrOperatorBenchmark.html>)	3.20 ns	52.57 ns	16.41	0.62	True
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OneBenchmark.html>)	2.14 ns	27.72 ns	12.93	0.69	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).MinBenchmark.html>)	3.23 ns	36.91 ns	11.41	0.53	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsAllBenchmark.html>)	2.24 ns	27.71 ns	12.36	0.69	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).LessThanOrEqualAllBenchmark.html>)	2.66 ns	31.60 ns	11.90	0.67	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).XorBenchmark.html>)	3.31 ns	53.11 ns	16.06	0.59	True
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).MultiplyBenchmark.html>)	3.78 ns	52.93 ns	14.01	0.58	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).ConditionalSelectBenchmark.html>)	5.10 ns	178.10 ns	34.94	0.62	True
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).CountBenchmark.html>)	0.25 ns	15.02 ns	61.16	0.88	True
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).AbsBenchmark.html>)	4.40 ns	17.70 ns	4.02	0.57	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).ExclusiveOrOperatorBenchmark.html>)	3.22 ns	56.70 ns	17.59	0.60	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.67778035625933 > 3.440859017566666. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.510183959911636 (T) = (0 -40.47105975907101) / Math.Sqrt((0.24164720450230506 / (32)) + (9.093866602999444 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.719765256895057 = (3.4532312612030163 - 40.47105975907101) / 3.4532312612030163 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.48509880546158 > 1.898510865552611. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -91.34378900844777 (T) = (0 -16.589272591574574) / Math.Sqrt((0.5240837511856129 / (33)) + (0.04065958505649428 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.979586484727558 = (1.8474428215363299 - 16.589272591574574) / 1.8474428215363299 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.005882601215305 > 2.689085340467534. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.642810141304478 (T) = (0 -22.330634925198613) / Math.Sqrt((0.6565283670270643 / (33)) + (16.620718374335258 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.4988722127557335 = (2.6274821371808783 - 22.330634925198613) / 2.6274821371808783 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.73220066414144 > 2.6274005871007087. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.01604312422466 (T) = (0 -33.30260635748203) / Math.Sqrt((0.3156259148844483 / (32)) + (1.8302163191862937 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.183567668675211 = (2.526069361073681 - 33.30260635748203) / 2.526069361073681 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.37920647445194 > 25.056342225628722. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.322304927414399 (T) = (0 -44.50003186736741) / Math.Sqrt((4.772354911749754 / (33)) + (9.669520869977957 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.7960467637116118 = (24.77665546714724 - 44.50003186736741) / 24.77665546714724 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.790879685055536 > 3.562060074267927. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.840937599573284 (T) = (0 -56.01679431614384) / Math.Sqrt((1.7186940325815914 / (33)) + (16.102009037924628 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.602476517057305 = (3.8361160348869614 - 56.01679431614384) / 3.8361160348869614 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.168096789496296 > 3.5734196662000772. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.72978848771248 (T) = (0 -37.41465221088236) / Math.Sqrt((0.7613991306291442 / (31)) + (8.92110459606934 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.395309190721099 = (3.28333804591701 - 37.41465221088236) / 3.28333804591701 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.01061124265544 > 3.541671333335355. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.44137766017915 (T) = (0 -34.354902528920675) / Math.Sqrt((0.5120222699603661 / (32)) + (21.066349671357887 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.92514857544646 = (3.461399319896357 - 34.354902528920675) / 3.461399319896357 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.89827364274798 > 2.2865609371172475. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.094868748115278 (T) = (0 -34.327266305610834) / Math.Sqrt((0.5032101229147362 / (33)) + (5.106826361510726 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.342144462899194 = (2.393454228160225 - 34.327266305610834) / 2.393454228160225 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.358033644551185 > 3.628884281888614. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.084896295773532 (T) = (0 -43.739271470618476) / Math.Sqrt((1.1872436750050297 / (33)) + (12.119769563417817 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.181802855700107 = (3.318155486728785 - 43.739271470618476) / 3.318155486728785 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.476974213811737 > 2.679486537710477. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.074333534284616 (T) = (0 -33.56861823911758) / Math.Sqrt((0.7969961453310903 / (33)) + (12.95855472643324 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.331470689036163 = (2.722190976698606 - 33.56861823911758) / 2.722190976698606 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.40427169744147 > 3.9347303305795687. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -80.8406406818635 (T) = (0 -86.35250579219718) / Math.Sqrt((1.2749462025924965 / (32)) + (3.009899986114248 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -21.80559201087559 = (3.786461923506181 - 86.35250579219718) / 3.786461923506181 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.029482649607345 > 2.4157309172298973. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.760191930757237 (T) = (0 -18.903143685204284) / Math.Sqrt((0.9925425879153625 / (31)) + (1.9724938960031286 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -6.844917633506034 = (2.4096038439547174 - 18.903143685204284) / 2.4096038439547174 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.15633602799809 > 3.3605728378841544. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.301320087828838 (T) = (0 -43.228569868679806) / Math.Sqrt((1.9489105099589106 / (33)) + (20.957709526256078 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.700717886589565 = (3.4036320036935854 - 43.228569868679806) / 3.4036320036935854 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.830094321494766 > 2.914254083069996. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.101118884994447 (T) = (0 -19.464845209625512) / Math.Sqrt((0.49107076000933786 / (32)) + (6.436968933233359 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.036555430113837 = (2.766246269634035 - 19.464845209625512) / 2.766246269634035 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.705860630647962 > 2.928798102487309. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -83.62300363439617 (T) = (0 -19.206002866936075) / Math.Sqrt((0.35781050104402723 / (32)) + (0.11110015576155603 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.110778549392404 = (2.700970468075844 - 19.206002866936075) / 2.700970468075844 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.84815745824678 > 3.5074003019665954. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.45662571700923 (T) = (0 -39.54749031318288) / Math.Sqrt((0.44675028813507833 / (33)) + (4.3478157605104055 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.628200711582576 = (3.400998253649901 - 39.54749031318288) / 3.400998253649901 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.92970788769413 > 2.546600732926637. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.78829674072902 (T) = (0 -18.456035214099522) / Math.Sqrt((1.3291935264208092 / (32)) + (0.6956106214961736 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.655560102709639 = (2.7730250992077474 - 18.456035214099522) / 2.7730250992077474 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.476728030837556 > 3.3440578074459633. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.77389488114362 (T) = (0 -41.67659049430447) / Math.Sqrt((0.7446288886744882 / (33)) + (13.565817374240424 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.657913366819319 = (3.2925324487962557 - 41.67659049430447) / 3.2925324487962557 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.05151583651207 > 3.571756316064353. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -154.04392354239297 (T) = (0 -52.80982840558136) / Math.Sqrt((0.6948544630065379 / (32)) + (0.3260388393007196 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.916835157268293 = (3.3178598561703505 - 52.80982840558136) / 3.3178598561703505 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.101078758067313 > 2.6399636823161923. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.449297710192376 (T) = (0 -20.265815836984977) / Math.Sqrt((0.7637130504981805 / (33)) + (2.2028942034012258 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.09970953707148 = (2.502042294755209 - 20.265815836984977) / 2.502042294755209 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.15418906953959 > 3.4530750239166395. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.11655633633172 (T) = (0 -52.84113310622077) / Math.Sqrt((0.23029905378330984 / (32)) + (6.0488302160786915 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.579028619027122 = (3.391811800235372 - 52.84113310622077) / 3.391811800235372 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.586938884357764 > 4.77758641616704. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -58.54102404226984 (T) = (0 -40.33240407745242) / Math.Sqrt((1.526784877239368 / (33)) + (1.275133724708081 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.12775607544006 = (4.96230493423964 - 40.33240407745242) / 4.96230493423964 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.94694987296699 > 3.368741679003089. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.39396850097475 (T) = (0 -43.77102575587899) / Math.Sqrt((0.7413679560516886 / (33)) + (15.782269099171055 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.911465457319112 = (3.1463993416200546 - 43.77102575587899) / 3.1463993416200546 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.09432765720798 > 3.637448786811064. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.81631373960684 (T) = (0 -34.06263929421103) / Math.Sqrt((2.2153197546200847 / (32)) + (3.8687642327606375 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.185689299081305 = (3.70822898371032 - 34.06263929421103) / 3.70822898371032 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.57524029384846 > 2.5780356833328497. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.55826329836513 (T) = (0 -35.02991932213197) / Math.Sqrt((0.5983949969235441 / (33)) + (12.06564768173219 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.96671886219518 = (2.701525319891268 - 35.02991932213197) / 2.701525319891268 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.57399946342755 > 3.385104834504821. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -421.66272210917674 (T) = (0 -52.39335021677225) / Math.Sqrt((0.24435441856853446 / (33)) + (0.02440683527193316 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.459922045166284 = (3.3889789394606686 - 52.39335021677225) / 3.3889789394606686 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.724113200156502 > 2.3736662870703147. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.147601956793714 (T) = (0 -25.9130388221257) / Math.Sqrt((0.9233654992759257 / (33)) + (1.467711328385529 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.354368505561864 = (1.940416636798166 - 25.9130388221257) / 1.940416636798166 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.91163768923068 > 3.824388032789746. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.63864555974723 (T) = (0 -38.004510489544785) / Math.Sqrt((0.8473831272942098 / (31)) + (6.121115388380368 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -9.82667795766854 = (3.510265165190969 - 38.004510489544785) / 3.510265165190969 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.713403237956697 > 2.5035127635413734. IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.2038301974093 (T) = (0 -25.989880187386465) / Math.Sqrt((0.5515852305211899 / (32)) + (1.5567811551776485 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.440831659927685 = (2.2716775283406925 - 25.989880187386465) / 2.2716775283406925 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.602607080903358 > 2.649314602771328. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.657424939489182 (T) = (0 -32.819887437121515) / Math.Sqrt((0.8370629139160337 / (33)) + (6.443154770139299 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.824555990037695 = (2.559144149911817 - 32.819887437121515) / 2.559144149911817 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.107389090460124 > 3.5915326176716866. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -162.9663036984895 (T) = (0 -53.273890604065954) / Math.Sqrt((0.35884257195906516 / (33)) + (0.33187157602824935 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.896007379889598 = (3.3514007216342874 - 53.273890604065954) / 3.3514007216342874 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.928195033021964 > 3.5117615066639645. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.13149141853882 (T) = (0 -45.61238446828314) / Math.Sqrt((0.36411567548488755 / (32)) + (27.454752062041678 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.759175466498968 = (3.315052168594027 - 45.61238446828314) / 3.315052168594027 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 178.10308527309994 > 3.644985541594901. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -534.5443332582795 (T) = (0 -178.53504330031402) / Math.Sqrt((0.39612173001887213 / (33)) + (0.3801413457904667 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -47.925228011393685 = (3.6491407512446723 - 178.53504330031402) / 3.6491407512446723 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.01625676300469 > 0.08186775581922191. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -43.544414076992446 (T) = (0 -15.272293531673636) / Math.Sqrt((0.05936367708962747 / (33)) + (0.4746651787906897 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -95.1389786937717 = (0.15885641536010037 - 15.272293531673636) / 0.15885641536010037 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.69746438872814 > 4.594594581261864. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.79074852753798 (T) = (0 -15.072304717476207) / Math.Sqrt((1.5984844875044364 / (33)) + (4.455795469151703 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -2.337166011673096 = (4.5164983296469785 - 15.072304717476207) / 4.5164983296469785 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.70216179288203 > 3.4591697458245414. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.75901702229695 (T) = (0 -53.72118855906398) / Math.Sqrt((1.8172428253118018 / (31)) + (4.52163739412018 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -13.047175351516175 = (3.8243409948794875 - 53.72118855906398) / 3.8243409948794875 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AbsBenchmark.html>)	8.04 ns	33.59 ns	4.18	0.63	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MultiplyOperatorBenchmark.html>)	3.27 ns	24.86 ns	7.59	0.62	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualsStaticBenchmark.html>)	3.35 ns	48.20 ns	14.38	0.59	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MultiplyBenchmark.html>)	3.26 ns	30.03 ns	9.22	0.64	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseAndBenchmark.html>)	3.54 ns	48.45 ns	13.70	0.59	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanOrEqualBenchmark.html>)	4.53 ns	60.43 ns	13.35	0.66	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AddOperatorBenchmark.html>)	7.08 ns	25.97 ns	3.67	0.57	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanBenchmark.html>)	4.42 ns	46.93 ns	10.62	0.61	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).InequalityOperatorBenchmark.html>)	1.95 ns	17.15 ns	8.78	0.70	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanAllBenchmark.html>)	3.49 ns	39.92 ns	11.44	0.69	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SubtractBenchmark.html>)	3.32 ns	29.48 ns	8.87	0.54	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DotBenchmark.html>)	2.51 ns	54.94 ns	21.92	0.81	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).ZeroBenchmark.html>)	2.61 ns	16.89 ns	6.47	0.70	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MinBenchmark.html>)	4.55 ns	48.06 ns	10.56	0.60	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanAnyBenchmark.html>)	3.04 ns	26.33 ns	8.68	0.74	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).XorBenchmark.html>)	3.28 ns	48.20 ns	14.70	0.66	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualityOperatorBenchmark.html>)	2.34 ns	18.93 ns	8.10	0.69	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseOrBenchmark.html>)	3.33 ns	48.22 ns	14.46	0.55	True
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanAllBenchmark.html>)	3.46 ns	35.51 ns	10.25	0.69	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).OnesComplementBenchmark.html>)	3.17 ns	44.48 ns	14.03	0.59	True
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanBenchmark.html>)	5.05 ns	49.78 ns	9.85	0.65	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanOrEqualAllBenchmark.html>)	5.77 ns	43.90 ns	7.60	0.69	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DivideBenchmark.html>)	21.86 ns	40.32 ns	1.84	0.45	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).NegateBenchmark.html>)	13.89 ns	37.68 ns	2.71	0.66	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanOrEqualAllBenchmark.html>)	3.24 ns	31.25 ns	9.65	0.64	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).ConditionalSelectBenchmark.html>)	3.51 ns	55.24 ns	15.73	0.65	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).OnesComplementOperatorBenchmark.html>)	5.65 ns	42.19 ns	7.46	0.58	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SumBenchmark.html>)	0.61 ns	27.72 ns	45.09	0.85	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseAndOperatorBenchmark.html>)	3.33 ns	50.50 ns	15.18	0.64	True
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SquareRootBenchmark.html>)	32.99 ns	47.58 ns	1.44	0.58	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).GreaterThanOrEqualAnyBenchmark.html>)	3.81 ns	26.45 ns	6.94	0.66	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AllBitsSetBenchmark.html>)	1.94 ns	29.60 ns	15.26	0.67	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).MaxBenchmark.html>)	4.54 ns	43.70 ns	9.62	0.60	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanOrEqualBenchmark.html>)	5.49 ns	44.00 ns	8.01	0.63	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AddBenchmark.html>)	3.93 ns	36.81 ns	9.37	0.63	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanAnyBenchmark.html>)	1.37 ns	38.84 ns	28.31	0.68	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).LessThanOrEqualAnyBenchmark.html>)	3.73 ns	44.57 ns	11.95	0.62	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).CountBenchmark.html>)	0.04 ns	15.00 ns	390.69	0.92	True
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualsAllBenchmark.html>)	3.19 ns	25.26 ns	7.91	0.69	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).EqualsAnyBenchmark.html>)	3.98 ns	43.09 ns	10.83	0.67	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).AndNotBenchmark.html>)	3.37 ns	48.48 ns	14.41	0.56	True
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).SubtractionOperatorBenchmark.html>)	4.93 ns	23.88 ns	4.85	0.63	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).BitwiseOrOperatorBenchmark.html>)	5.32 ns	51.25 ns	9.63	0.58	True
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).ExclusiveOrOperatorBenchmark.html>)	3.67 ns	48.32 ns	13.16	0.58	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.592824028768796 > 7.271554042122547. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.794230924740944 (T) = (0 -31.25967954672764) / Math.Sqrt((3.5156520012862864 / (31)) + (17.337788022793095 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -3.895248331598914 = (6.385718850041959 - 31.25967954672764) / 6.385718850041959 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.857812643673007 > 3.491482344205781. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -95.31683542845047 (T) = (0 -24.89269973590354) / Math.Sqrt((1.1821441587023434 / (33)) + (0.05249248834758236 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.541898339343815 = (3.8051187047948534 - 24.89269973590354) / 3.8051187047948534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.20065511758023 > 3.469450788324752. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.723833372693768 (T) = (0 -42.556357457072096) / Math.Sqrt((0.4317168568402329 / (32)) + (24.401405061642546 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -11.576557189526984 = (3.383784354951332 - 42.556357457072096) / 3.383784354951332 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.03058221808464 > 3.5454726036084145. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.921367670913956 (T) = (0 -33.18737436540576) / Math.Sqrt((0.5468960160358514 / (32)) + (20.86423531997908 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.14667683334317 = (3.62835322271636 - 33.18737436540576) / 3.62835322271636 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.44913790006123 > 3.4763715704684635. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -153.98954907438605 (T) = (0 -47.99303165750153) / Math.Sqrt((0.20306796033801405 / (33)) + (0.30973307732172195 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.820833951053118 = (3.472513440756921 - 47.99303165750153) / 3.472513440756921 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 60.42989552133945 > 4.773382378082128. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.131910249204267 (T) = (0 -53.286347947954575) / Math.Sqrt((0.5912381439616584 / (33)) + (23.502365776582774 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.074803963496494 = (4.413019715189188 - 53.286347947954575) / 4.413019715189188 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.96849258202797 > 3.5543637438357827. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.32994931291411 (T) = (0 -24.37128961195358) / Math.Sqrt((0.9469285162063892 / (33)) + (1.432506902226651 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.6922194666063595 = (3.6417349630514013 - 24.37128961195358) / 3.6417349630514013 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.92549609299314 > 4.8831116021175305. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.550194784410177 (T) = (0 -44.99505574305736) / Math.Sqrt((0.7052247057664737 / (33)) + (11.850008589682025 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.428293335366568 = (4.314709444397857 - 44.99505574305736) / 4.314709444397857 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.153942282792798 > 2.709319782795635. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.176002706818032 (T) = (0 -19.53484481582617) / Math.Sqrt((0.7052913424749088 / (32)) + (8.746283480745559 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.676882370636647 = (2.925743443037997 - 19.53484481582617) / 2.925743443037997 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.91646663652202 > 3.861596265812045. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.126534779329436 (T) = (0 -41.97271213971578) / Math.Sqrt((1.0806277973841711 / (33)) + (6.310129297406763 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.213303780618864 = (3.743117368519138 - 41.97271213971578) / 3.743117368519138 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.47560393984803 > 3.5082068859060667. IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.54244986387493 (T) = (0 -35.200958964215275) / Math.Sqrt((0.8116428750216287 / (32)) + (16.403199273432442 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.698190630951437 = (3.629641889268772 - 35.200958964215275) / 3.629641889268772 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.93810773105658 > 2.6963394656379327. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.31976478208887 (T) = (0 -48.43091726030242) / Math.Sqrt((1.6304914266387223 / (33)) + (24.488948647796466 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.588792949250148 = (2.919496156740663 - 48.43091726030242) / 2.919496156740663 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.890990777002248 > 2.036912865047724. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -62.26624850366129 (T) = (0 -16.532374729870284) / Math.Sqrt((0.3389088091000045 / (33)) + (0.17999838265008264 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.729256031466282 = (1.8939042079045636 - 16.532374729870284) / 1.8939042079045636 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.05790826817444 > 5.0266853997400025. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.6006526461987 (T) = (0 -45.68236898697307) / Math.Sqrt((0.5355998963957628 / (32)) + (5.519722104340925 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.534895096692294 = (4.791072006950609 - 45.68236898697307) / 4.791072006950609 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.332959724026754 > 3.35181437197861. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.024687499749607 (T) = (0 -29.63448847328274) / Math.Sqrt((0.8999532845066883 / (32)) + (22.350989989025535 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.446790883405139 = (3.5083724555681486 - 29.63448847328274) / 3.5083724555681486 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.199044865503915 > 3.5594433210855985. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.569254938104656 (T) = (0 -51.28010380550925) / Math.Sqrt((0.9372131540697405 / (32)) + (5.479587770988395 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.577705854196743 = (3.291890621473895 - 51.28010380550925) / 3.291890621473895 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.928098632546018 > 2.386669806456205. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.154144674140701 (T) = (0 -20.62398584470626) / Math.Sqrt((1.3034859838676556 / (33)) + (19.509826821730112 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.1106954625349355 = (2.5428134911454796 - 20.62398584470626) / 2.5428134911454796 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.22438039077222 > 3.5817560333364726. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -211.164426896533 (T) = (0 -48.562267978958936) / Math.Sqrt((0.609509380165395 / (33)) + (0.10818262239278208 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.829032710374035 = (3.511617117119789 - 48.562267978958936) / 3.511617117119789 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.510127381509186 > 3.7062743490831647. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.84957290838016 (T) = (0 -33.21987486131743) / Math.Sqrt((0.6616626304764696 / (33)) + (9.68720580548711 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.823973640592698 = (3.7647296121213345 - 33.21987486131743) / 3.7647296121213345 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.47722097990259 > 3.324059653341332. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -68.80135231143915 (T) = (0 -42.78497785354032) / Math.Sqrt((0.29927593671213615 / (33)) + (1.2742512845656797 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.570200356994098 = (3.4036830470832253 - 42.78497785354032) / 3.4036830470832253 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.77759402750312 > 5.014793824249362. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.018300194312975 (T) = (0 -53.071490150550254) / Math.Sqrt((0.6603146711697596 / (33)) + (17.56764193156742 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.237916694316091 = (4.722538135328297 - 53.071490150550254) / 4.722538135328297 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.90307539230629 > 4.259505657384637. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.852684978857862 (T) = (0 -40.32250987581716) / Math.Sqrt((1.4395812385705853 / (32)) + (11.033752143006325 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.7998525674051 = (3.7336166974643734 - 40.32250987581716) / 3.7336166974643734 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.32063802083334 > 23.307090258254068. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.981003989186753 (T) = (0 -40.366211679970114) / Math.Sqrt((1.4804295352952561 / (33)) + (12.564738553865771 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.7900267199983537 = (22.550619624274233 - 40.366211679970114) / 22.550619624274233 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.68186849505728 > 16.019708581121282. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.011305032248607 (T) = (0 -33.29853811483996) / Math.Sqrt((5.309991259787756 / (33)) + (11.933031924151322 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.14184049619582 = (15.546693684232034 - 33.29853811483996) / 15.546693684232034 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.252041848055814 > 3.687737560636422. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.68612111226514 (T) = (0 -28.032566293328642) / Math.Sqrt((0.374843056719089 / (33)) + (7.612216566197059 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.8706912505950495 = (3.5616396833263266 - 28.032566293328642) / 3.5616396833263266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.24405796205251 > 3.68488466081359. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -69.95800777432939 (T) = (0 -53.52848147427193) / Math.Sqrt((0.9637737159416557 / (32)) + (1.892999551464973 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.745055241537633 = (3.8943809634543016 - 53.52848147427193) / 3.8943809634543016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.1934200698532 > 5.957550716987759. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.21945593371352 (T) = (0 -43.31428364145708) / Math.Sqrt((2.5585405185074688 / (33)) + (2.170855851516477 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.070234615301307 = (6.126286608327946 - 43.31428364145708) / 6.126286608327946 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.720933677401874 > 1.610862350618001. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.742728950027567 (T) = (0 -27.736514706606815) / Math.Sqrt((1.3159973273701555 / (31)) + (12.376121158229694 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -16.04793769317855 = (1.6269718487829246 - 27.736514706606815) / 1.6269718487829246 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.498378023765916 > 3.318633145694357. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.773528050327682 (T) = (0 -56.516612176198784) / Math.Sqrt((0.45751093590761954 / (33)) + (186.8272423425649 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.708106118517456 = (3.3825863790487833 - 56.516612176198784) / 3.3825863790487833 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.57801279448852 > 34.54768023668929. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.600807191897841 (T) = (0 -53.229710531624484) / Math.Sqrt((7.549223299705186 / (32)) + (71.16144225902316 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.5797089159709734 = (33.69589801859583 - 53.229710531624484) / 33.69589801859583 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.453171805378837 > 3.9065514817931883. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.78369298135989 (T) = (0 -29.082968749485673) / Math.Sqrt((0.7257257093631367 / (33)) + (15.633334676387634 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.777784079435242 = (3.7392358096417397 - 29.082968749485673) / 3.7392358096417397 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.598105242770966 > 2.0430479731897955. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -112.40695509604747 (T) = (0 -29.333521750292185) / Math.Sqrt((0.6675728238363593 / (32)) + (0.15002268570757787 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.47580540036351 = (2.176754626443397 - 29.333521750292185) / 2.176754626443397 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.69892610602203 > 4.800257196312571. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.1789372121958 (T) = (0 -43.46322502387319) / Math.Sqrt((3.0138520008583547 / (33)) + (3.304638020922864 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.731791423176576 = (4.977583970742801 - 43.46322502387319) / 4.977583970742801 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.9986885396627 > 5.0310274646945485. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.543649573211802 (T) = (0 -42.98584763985701) / Math.Sqrt((0.5485517006639667 / (33)) + (5.841854531267251 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.245992003519703 = (4.64913311881445 - 42.98584763985701) / 4.64913311881445 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.806964628840255 > 3.9390817506950446. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.841629652707685 (T) = (0 -32.86966115953094) / Math.Sqrt((0.5001240557112354 / (32)) + (10.820341296325788 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.553387685302983 = (3.4406288368363738 - 32.86966115953094) / 3.4406288368363738 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.835765038262146 > 3.141682262805715. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.914289636249176 (T) = (0 -41.66929385792509) / Math.Sqrt((0.9210858225778203 / (33)) + (9.352244130203461 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.450360972103685 = (3.346834196316832 - 41.66929385792509) / 3.346834196316832 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.56832169541537 > 4.032735414631054. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.84900262651841 (T) = (0 -41.21056035035294) / Math.Sqrt((0.40328264433069316 / (33)) + (8.41519538263663 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.418217078120392 = (3.609193980846685 - 41.21056035035294) / 3.609193980846685 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.99547151058911 > 0.13191788828211756. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -126.84820679650831 (T) = (0 -15.081193931902593) / Math.Sqrt((0.2279673292415926 / (33)) + (0.02708931413547321 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -60.65644176236295 = (0.24460045861921004 - 15.081193931902593) / 0.24460045861921004 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.26319378697327 > 2.3722758325353426. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.16264630698622 (T) = (0 -29.021763617760936) / Math.Sqrt((0.6353835805493688 / (32)) + (8.437880988388153 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.52366835547342 = (2.518448355377774 - 29.021763617760936) / 2.518448355377774 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.087371484350825 > 3.40267162490111. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -53.42732626677637 (T) = (0 -41.25698836163765) / Math.Sqrt((0.8194829751019502 / (32)) + (1.9766145849751888 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.063919164040446 = (2.738795124453635 - 41.25698836163765) / 2.738795124453635 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.482522118302114 > 3.544148347870627. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -64.77176050568994 (T) = (0 -49.78439423482264) / Math.Sqrt((0.9226987046605967 / (31)) + (1.9346351139855662 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -13.759141837678765 = (3.3731225556575075 - 49.78439423482264) / 3.3731225556575075 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.884634624651724 > 3.975546960557207. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.774813227904803 (T) = (0 -25.254066954487364) / Math.Sqrt((1.534163239762008 / (32)) + (13.33373542214921 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.011262103103988 = (3.601928808695801 - 25.254066954487364) / 3.601928808695801 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.24547588010542 > 3.5280230281422336. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -57.840923564411696 (T) = (0 -49.16859999989025) / Math.Sqrt((0.7551709445137071 / (33)) + (2.4182227648927914 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.667672478516788 = (3.3521746597427593 - 49.16859999989025) / 3.3521746597427593 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.32366812739283 > 3.6660225752600173. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -48.43340980104327 (T) = (0 -49.26411836758435) / Math.Sqrt((0.3305133619745811 / (32)) + (3.576903709140144 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.394855209152427 = (3.2000377852398536 - 49.26411836758435) / 3.2000377852398536 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).CountBenchmark.html>)	0.00 ns	14.70 ns	∞	0.87	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementBenchmark.html>)	1.32 ns	39.76 ns	30.17	0.67	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanAllBenchmark.html>)	3.43 ns	18.66 ns	5.44	0.71	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).DivideBenchmark.html>)	26.90 ns	43.00 ns	1.60	0.47	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyBenchmark.html>)	2.37 ns	36.55 ns	15.39	0.63	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).InequalityOperatorBenchmark.html>)	4.69 ns	23.56 ns	5.02	0.66	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).AddOperatorBenchmark.html>)	3.19 ns	23.13 ns	7.24	0.58	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).MultiplyOperatorBenchmark.html>)	3.34 ns	25.45 ns	7.62	0.63	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanAnyBenchmark.html>)	2.65 ns	24.72 ns	9.31	0.69	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).XorBenchmark.html>)	3.60 ns	52.92 ns	14.70	0.63	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementOperatorBenchmark.html>)	5.32 ns	42.26 ns	7.95	0.66	True
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseOrBenchmark.html>)	3.38 ns	56.22 ns	16.63	0.55	True
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanBenchmark.html>)	4.99 ns	32.89 ns	6.59	0.63	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).AddBenchmark.html>)	4.99 ns	30.25 ns	6.06	0.61	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualAllBenchmark.html>)	3.89 ns	18.52 ns	4.77	0.69	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsAnyBenchmark.html>)	2.51 ns	30.30 ns	12.07	0.67	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanAnyBenchmark.html>)	3.56 ns	22.33 ns	6.27	0.70	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).SubtractionOperatorBenchmark.html>)	3.34 ns	22.44 ns	6.72	0.61	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseOrOperatorBenchmark.html>)	3.24 ns	53.05 ns	16.39	0.63	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).AndNotBenchmark.html>)	1.84 ns	90.64 ns	49.34	0.62	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseAndBenchmark.html>)	3.43 ns	53.44 ns	15.59	0.57	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).MaxBenchmark.html>)	4.25 ns	30.73 ns	7.23	0.58	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).ConditionalSelectBenchmark.html>)	5.08 ns	176.04 ns	34.66	0.60	True
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).DotBenchmark.html>)	2.57 ns	32.06 ns	12.48	0.85	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseAndOperatorBenchmark.html>)	3.37 ns	52.33 ns	15.54	0.59	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualAnyBenchmark.html>)	3.60 ns	17.99 ns	5.00	0.69	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).ExclusiveOrOperatorBenchmark.html>)	0.63 ns	52.17 ns	82.27	0.62	True
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsStaticBenchmark.html>)	3.28 ns	28.92 ns	8.82	0.55	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).ZeroBenchmark.html>)	3.13 ns	16.70 ns	5.33	0.67	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualAnyBenchmark.html>)	3.38 ns	26.35 ns	7.79	0.67	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanOrEqualBenchmark.html>)	4.76 ns	26.10 ns	5.49	0.57	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualsAllBenchmark.html>)	2.66 ns	32.54 ns	12.22	0.63	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).GreaterThanBenchmark.html>)	5.54 ns	25.52 ns	4.61	0.60	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).EqualityOperatorBenchmark.html>)	2.49 ns	17.99 ns	7.22	0.67	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualBenchmark.html>)	4.37 ns	35.42 ns	8.10	0.66	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).AbsBenchmark.html>)	4.21 ns	12.57 ns	2.98	0.59	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).MinBenchmark.html>)	4.98 ns	28.93 ns	5.81	0.66	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanAllBenchmark.html>)	4.30 ns	31.92 ns	7.43	0.62	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).NegateBenchmark.html>)	3.28 ns	22.66 ns	6.91	0.60	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).SubtractBenchmark.html>)	3.03 ns	33.48 ns	11.03	0.60	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).LessThanOrEqualAllBenchmark.html>)	3.35 ns	23.45 ns	7.01	0.72	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt64&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt64>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.697993642453214 > 0. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.089780484877856 (T) = (0 -14.431577047682694) / Math.Sqrt((0.6095190488381287 / (33)) + (0.7003435718664969 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -45.00847901845553 = (0.31367211773929127 - 14.431577047682694) / 0.31367211773929127 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.76241509586698 > 2.777135056119839. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.449269786572348 (T) = (0 -41.28121316347413) / Math.Sqrt((1.2039852148651904 / (33)) + (5.7519110871085575 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.34591644783352 = (3.0931718570870737 - 41.28121316347413) / 3.0931718570870737 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.663288639089647 > 3.6633139931060477. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.890957464849507 (T) = (0 -21.08964358895257) / Math.Sqrt((0.2341910918778438 / (32)) + (4.876840450235719 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.041827546695132 = (3.490606679180799 - 21.08964358895257) / 3.490606679180799 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.00347549344246 > 24.4890321317677. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.444637762530093 (T) = (0 -42.41269710829941) / Math.Sqrt((2.8264692837429384 / (31)) + (2.241654464990381 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.8699898447816392 = (22.680709858748987 - 42.41269710829941) / 22.680709858748987 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.54611913348398 > 3.421481632420339. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.666393655249934 (T) = (0 -35.38984930750945) / Math.Sqrt((0.31668447982794823 / (33)) + (8.732583497992874 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.703290507995217 = (3.306445740314505 - 35.38984930750945) / 3.306445740314505 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.559793301907067 > 2.7497154981141816. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.12019153113143 (T) = (0 -21.34908010554072) / Math.Sqrt((0.918409765477853 / (33)) + (2.2948363488714576 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.081558711405413 = (2.6417032738264963 - 21.34908010554072) / 2.6417032738264963 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.128404204736544 > 3.461358475233767. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.74457543612584 (T) = (0 -25.261853342217044) / Math.Sqrt((0.3498305103211713 / (33)) + (2.625927379300955 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.3904284577245605 = (3.4181852225107554 - 25.261853342217044) / 3.4181852225107554 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.452136432438845 > 3.5444532947804865. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.268937543554543 (T) = (0 -24.88105696669459) / Math.Sqrt((0.6928737256417044 / (33)) + (3.620549015168836 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.211146215940022 = (3.450360902639273 - 24.88105696669459) / 3.450360902639273 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.718162362546092 > 3.047490741869459. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.579825861164554 (T) = (0 -27.585848317337675) / Math.Sqrt((0.7311821222399161 / (33)) + (25.750144803675074 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.519848359249985 = (3.237833251737135 - 27.585848317337675) / 3.237833251737135 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.916754227833316 > 3.746158445327821. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -76.76027808754002 (T) = (0 -52.56539344257313) / Math.Sqrt((0.455946665540783 / (33)) + (1.5802247765401203 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.094385686290622 = (3.482446688129568 - 52.56539344257313) / 3.482446688129568 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.257048938806555 > 4.74465542063496. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.97425909730157 (T) = (0 -43.095035333322954) / Math.Sqrt((1.0102464071608073 / (33)) + (9.296223951516469 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.030427039613471 = (4.7722034787811705 - 43.095035333322954) / 4.7722034787811705 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.22126288062231 > 3.43471739867381. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.64615422219136 (T) = (0 -54.190272709637235) / Math.Sqrt((1.0706549560923062 / (33)) + (3.8853696881215782 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.71496444894574 = (3.4483229590298348 - 54.190272709637235) / 3.4483229590298348 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.89180266435402 > 4.651847424393843. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.385631072512258 (T) = (0 -34.653929658280944) / Math.Sqrt((0.44544700742178023 / (32)) + (17.570187551036767 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.7765520337997875 = (4.45620752071896 - 34.653929658280944) / 4.45620752071896 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.248346072888143 > 3.451628094733841. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.47150741917574 (T) = (0 -31.300618914453185) / Math.Sqrt((1.0241883226741542 / (32)) + (2.048216081182977 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.548627315295895 = (3.6614789439291133 - 31.300618914453185) / 3.6614789439291133 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.52471255615799 > 3.593585119873612. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.636144204413663 (T) = (0 -20.530213649391143) / Math.Sqrt((0.7497619844040107 / (33)) + (3.858595102901443 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -4.423672068101975 = (3.7852977450710314 - 20.530213649391143) / 3.7852977450710314 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.29645669836482 > 2.6720470081028935. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.104339264918002 (T) = (0 -25.448532359633678) / Math.Sqrt((0.3066417110109116 / (33)) + (14.31800064289803 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.106881295175134 = (2.5179411547835637 - 25.448532359633678) / 2.5179411547835637 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.327621494327804 > 3.296434754753657. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.118754135532157 (T) = (0 -20.172792310359934) / Math.Sqrt((1.0840954107644485 / (33)) + (4.215585741099148 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -4.986981485530954 = (3.369442908603035 - 20.172792310359934) / 3.369442908603035 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.436757341656048 > 3.5492959891688027. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.020068753776913 (T) = (0 -25.948103989002558) / Math.Sqrt((1.260571465412439 / (33)) + (16.134742614125628 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.9925817616809285 = (3.710804517323936 - 25.948103989002558) / 3.710804517323936 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.050600887270015 > 3.9268564276952107. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -114.85728991238025 (T) = (0 -53.32403191112204) / Math.Sqrt((2.2285007043219243 / (33)) + (0.4843295923615601 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.492124054236506 = (3.4420090960051377 - 53.32403191112204) / 3.4420090960051377 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 90.63677522965772 > 3.413041708777734. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.88968564334402 (T) = (0 -88.51489338495347) / Math.Sqrt((0.7872429132006482 / (32)) + (19.079313037467006 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -25.333416353703974 = (3.3613144681283726 - 88.51489338495347) / 3.3613144681283726 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.43837507970786 > 3.5578003484747978. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -77.30729185213261 (T) = (0 -53.28184776543933) / Math.Sqrt((1.0168785956867297 / (33)) + (1.5379290406915842 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.389123670991392 = (3.4623055155425124 - 53.28184776543933) / 3.4623055155425124 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.72604140391287 > 4.87945807145102. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.033080919555946 (T) = (0 -29.550799497667104) / Math.Sqrt((0.4257048311841713 / (33)) + (2.6966163887415457 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.345787337975911 = (4.656758558677574 - 29.550799497667104) / 4.656758558677574 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 176.03590009847707 > 4.765963442391388. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -607.0767043085299 (T) = (0 -176.27119480459467) / Math.Sqrt((2.0384718700633573 / (32)) + (0.06634441110192475 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -40.4287443265718 = (4.254804186559351 - 176.27119480459467) / 4.254804186559351 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.062423747454844 > 2.8059460862508976. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.545026648802676 (T) = (0 -33.91821152245663) / Math.Sqrt((3.0776557849753914 / (31)) + (12.133962468488916 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.842291509750945 = (2.864159482523156 - 33.91821152245663) / 2.864159482523156 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.325676105716305 > 3.5015392468245556. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -58.09823800272651 (T) = (0 -53.22453868673769) / Math.Sqrt((0.3013329303874974 / (33)) + (2.903753667300448 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.593218843745117 = (3.413313134387745 - 53.22453868673769) / 3.413313134387745 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.985668775670394 > 3.7429944273400455. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.336556761619322 (T) = (0 -21.177024170362976) / Math.Sqrt((0.8557120723980581 / (32)) + (11.390455230043594 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -4.797943445902013 = (3.6525061632553344 - 21.177024170362976) / 3.6525061632553344 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.16850447579533 > 3.4650523999218694. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -91.76429224198377 (T) = (0 -53.04007935400503) / Math.Sqrt((1.712424114307882 / (33)) + (0.9452707106653547 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.045515874876314 = (3.776299840213032 - 53.04007935400503) / 3.776299840213032 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.923530766239566 > 3.484886283794061. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.904734322623927 (T) = (0 -27.79398505521526) / Math.Sqrt((0.6792424136774436 / (32)) + (5.863550381760825 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.894442131131123 = (3.5207028683650523 - 27.79398505521526) / 3.5207028683650523 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.6970469854174 > 2.334879327219895. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.938614366061987 (T) = (0 -16.253380874829332) / Math.Sqrt((0.8775478141830005 / (32)) + (2.579854426521872 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.875804206580364 = (2.363851614517227 - 16.253380874829332) / 2.363851614517227 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.353851995111476 > 3.655894597655318. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -94.26622368140252 (T) = (0 -26.04930324727441) / Math.Sqrt((0.19071650762779904 / (32)) + (0.20207169642902126 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.142906638898029 = (3.6468771837809104 - 26.04930324727441) / 3.6468771837809104 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.103110475475376 > 5.173576846777137. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -81.45667247678529 (T) = (0 -25.96464716394827) / Math.Sqrt((0.5743499381790272 / (33)) + (0.1995574984785916 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -4.37135105133889 = (4.833913649616365 - 25.96464716394827) / 4.833913649616365 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.54276101184552 > 2.3553237400050344. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.528930467607308 (T) = (0 -28.955249907330867) / Math.Sqrt((0.5670906126362101 / (31)) + (17.729418842585414 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.474160222774117 = (2.523518004381704 - 28.955249907330867) / 2.523518004381704 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.524582730916787 > 4.808830042401713. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.72874270551561 (T) = (0 -27.394440563415102) / Math.Sqrt((0.6408525279704188 / (32)) + (4.83503885756733 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.202752581819485 = (4.416497385968497 - 27.394440563415102) / 4.416497385968497 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.98960999376184 > 2.6097572676870886. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.977633632402176 (T) = (0 -19.884594679922024) / Math.Sqrt((0.6152427937597174 / (33)) + (6.9481074980429165 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.394772850614824 = (2.6890068270682255 - 19.884594679922024) / 2.6890068270682255 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.41638489515735 > 4.694878808161699. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.219252855993684 (T) = (0 -33.22110469627796) / Math.Sqrt((0.8605200755757489 / (33)) + (3.287970689061257 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.430206840159254 = (4.471087469156635 - 33.22110469627796) / 4.471087469156635 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.574428179589631 > 4.433623897157685. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.080722417645026 (T) = (0 -13.962624875049181) / Math.Sqrt((0.8472991824423636 / (33)) + (2.56302562457433 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -2.4051100713261406 = (4.100491491486897 - 13.962624875049181) / 4.100491491486897 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.92683972021618 > 5.028825877671353. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.924791280033407 (T) = (0 -27.30648033414245) / Math.Sqrt((0.30035824005938966 / (33)) + (2.2632356097858506 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -4.91478678823424 = (4.616646603130446 - 27.30648033414245) / 4.616646603130446 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.916229868241977 > 4.116294655678676. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.374812570564508 (T) = (0 -27.324170449078842) / Math.Sqrt((0.6636129640608972 / (33)) + (12.65189422404121 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.892815534675787 = (3.461904098611528 - 27.324170449078842) / 3.461904098611528 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.658910779611194 > 3.5164838653222645. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.358469775130866 (T) = (0 -26.714908806828007) / Math.Sqrt((1.6166126449802305 / (33)) + (52.50931876018239 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.351027759674879 = (3.6341732993278146 - 26.714908806828007) / 3.6341732993278146 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.477401102668416 > 3.5309438699993816. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.373741034370568 (T) = (0 -33.58378590228934) / Math.Sqrt((0.5746023344770333 / (33)) + (4.440850990353744 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.723722159450716 = (3.4537994146252387 - 33.58378590228934) / 3.4537994146252387 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.447070642371752 > 3.5458648311581245. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.363604111172116 (T) = (0 -23.452154904565226) / Math.Sqrt((0.4691674513603515 / (33)) + (1.4499699970521485 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.5354573784828425 = (3.5884489097547245 - 23.452154904565226) / 3.5884489097547245 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CtorFromCollection(Int32).Dictionary(Size%3a%20512).html>)	5.39 μs	7.89 μs	1.46	0.11	True
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CtorFromCollection(Int32).FrozenDictionary(Size%3a%20512).html>)	5.68 μs	8.18 μs	1.44	0.10	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.891685189952309 > 5.6604025399228854. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.00429868694809 (T) = (0 -7839.525445716284) / Math.Sqrt((582.0058683722706 / (32)) + (17281.764980002074 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.4511952300838973 = (5402.116326735074 - 7839.525445716284) / 5402.116326735074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Collections.CtorFromCollection<Int32>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.184103891641735 > 5.981757856531031. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -128.72898535191732 (T) = (0 -8198.943373801232) / Math.Sqrt((5034.037582043201 / (32)) + (912.313866859663 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.44555972335982014 = (5671.812268499681 - 8198.943373801232) / 5671.812268499681 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).ConditionalSelectBenchmark.html>)	3.53 ns	175.82 ns	49.87	0.58	True
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).ZeroBenchmark.html>)	2.16 ns	16.14 ns	7.47	0.62	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AddOperatorBenchmark.html>)	4.50 ns	59.04 ns	13.12	0.43	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualsStaticBenchmark.html>)	3.28 ns	71.03 ns	21.67	0.51	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanBenchmark.html>)	3.27 ns	63.91 ns	19.52	0.46	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AddBenchmark.html>)	3.91 ns	68.28 ns	17.44	0.49	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanOrEqualAllBenchmark.html>)	1.12 ns	21.53 ns	19.14	0.69	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseOrBenchmark.html>)	3.35 ns	52.09 ns	15.54	0.58	True
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).OneBenchmark.html>)	1.95 ns	28.18 ns	14.44	0.74	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).LessThanAnyBenchmark.html>)	2.80 ns	18.78 ns	6.71	0.70	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).XorBenchmark.html>)	3.20 ns	52.19 ns	16.31	0.54	True
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanOrEqualBenchmark.html>)	3.62 ns	63.61 ns	17.57	0.57	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanOrEqualAnyBenchmark.html>)	2.37 ns	63.29 ns	26.67	0.57	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AbsBenchmark.html>)	3.88 ns	68.55 ns	17.68	0.55	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanAnyBenchmark.html>)	4.09 ns	55.82 ns	13.64	0.55	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseAndOperatorBenchmark.html>)	3.33 ns	57.24 ns	17.16	0.58	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).DivisionOperatorBenchmark.html>)	51.59 ns	84.65 ns	1.64	0.25	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).LessThanAllBenchmark.html>)	3.69 ns	59.56 ns	16.14	0.57	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseAndBenchmark.html>)	3.20 ns	52.47 ns	16.39	0.60	True
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).MultiplyOperatorBenchmark.html>)	3.35 ns	56.63 ns	16.89	0.51	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualityOperatorBenchmark.html>)	0.98 ns	18.18 ns	18.59	0.73	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).DivideBenchmark.html>)	53.43 ns	74.76 ns	1.40	0.31	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).SubtractionOperatorBenchmark.html>)	2.49 ns	59.38 ns	23.81	0.48	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).MinBenchmark.html>)	3.34 ns	68.36 ns	20.48	0.48	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).InequalityOperatorBenchmark.html>)	2.52 ns	25.59 ns	10.17	0.67	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualsAnyBenchmark.html>)	2.81 ns	60.00 ns	21.32	0.56	False
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).SquareRootBenchmark.html>)	43.16 ns	71.66 ns	1.66	0.35	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).DotBenchmark.html>)	2.63 ns	86.99 ns	33.06	0.54	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseOrOperatorBenchmark.html>)	3.46 ns	58.97 ns	17.03	0.63	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).OnesComplementOperatorBenchmark.html>)	3.87 ns	41.25 ns	10.65	0.64	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).MaxBenchmark.html>)	3.73 ns	65.35 ns	17.53	0.52	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).OnesComplementBenchmark.html>)	3.73 ns	41.04 ns	11.00	0.67	True
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).ExclusiveOrOperatorBenchmark.html>)	3.35 ns	52.66 ns	15.70	0.59	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AndNotBenchmark.html>)	3.42 ns	86.75 ns	25.39	0.50	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).GreaterThanAllBenchmark.html>)	2.30 ns	18.78 ns	8.16	0.71	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).MultiplyBenchmark.html>)	3.16 ns	69.41 ns	21.96	0.55	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).LessThanOrEqualAllBenchmark.html>)	2.47 ns	55.95 ns	22.61	0.61	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualsAllBenchmark.html>)	2.27 ns	33.10 ns	14.60	0.72	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).CountBenchmark.html>)	0.00 ns	16.72 ns	29266.09	0.92	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).LessThanOrEqualAnyBenchmark.html>)	2.64 ns	19.79 ns	7.49	0.69	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).LessThanBenchmark.html>)	2.79 ns	92.22 ns	33.05	0.50	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).SubtractBenchmark.html>)	3.33 ns	65.30 ns	19.60	0.48	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int16&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 175.81780973883806 > 3.7908672403299493. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -73.28216980906915 (T) = (0 -179.1245094653119) / Math.Sqrt((0.4575057008147146 / (31)) + (22.86820082860073 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -47.69851491978882 = (3.6782335100022525 - 179.1245094653119) / 3.6782335100022525 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.137847214584365 > 2.0347266291794446. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.07101125344428 (T) = (0 -16.096063112902616) / Math.Sqrt((1.485168711161919 / (32)) + (0.4750560317941967 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.157007716084494 = (2.248993399396328 - 16.096063112902616) / 2.248993399396328 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.03533904011677 > 3.5256891522850333. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.001598036126296 (T) = (0 -57.552916074440645) / Math.Sqrt((0.5957425980647134 / (33)) + (5.224878223945499 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.610404685413318 = (3.464871396238866 - 57.552916074440645) / 3.464871396238866 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.02659245545115 > 3.5174425226195147. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.49404427833329 (T) = (0 -68.1589369127793) / Math.Sqrt((0.7477685785695074 / (31)) + (13.807185513005324 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -16.70875828329635 = (3.848882898642853 - 68.1589369127793) / 3.848882898642853 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.91044931777823 > 3.545769555059477. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.816105536828644 (T) = (0 -66.41017198737836) / Math.Sqrt((0.09249219204077501 / (32)) + (4.904964231258897 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -18.41639302691134 = (3.420314571060295 - 66.41017198737836) / 3.420314571060295 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.27653825870698 > 3.5498351954283502. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.81504928013417 (T) = (0 -70.30266037124315) / Math.Sqrt((0.4084963838624376 / (32)) + (63.39150280677094 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -20.07381597145945 = (3.336019469205529 - 70.30266037124315) / 3.336019469205529 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.526262121722823 > 2.4034930385455486. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.66604896224243 (T) = (0 -20.15562544876086) / Math.Sqrt((0.5677835340003587 / (32)) + (1.3375845845778125 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.899840480662448 = (2.5513965121319377 - 20.15562544876086) / 2.5513965121319377 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.09407587068178 > 3.5835291044940707. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.332641583487025 (T) = (0 -57.460570296027555) / Math.Sqrt((1.4974239680891979 / (32)) + (108.23252770796842 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.672346233343328 = (3.6663668247565053 - 57.460570296027555) / 3.6663668247565053 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.177361648253857 > 2.0993885343923653. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.597020981392156 (T) = (0 -26.13300813856778) / Math.Sqrt((0.7860206740430117 / (32)) + (17.021900808869628 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.207139210780168 = (2.140797093187045 - 26.13300813856778) / 2.140797093187045 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.775585332561775 > 2.706987097414579. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.426928811716133 (T) = (0 -22.15075152460556) / Math.Sqrt((1.7735104004232705 / (33)) + (16.37590329223548 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.503853344328352 = (2.9519169029799595 - 22.15075152460556) / 2.9519169029799595 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.19095346619978 > 3.4348784459834465. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -206.20909437444266 (T) = (0 -52.405833154664464) / Math.Sqrt((0.6354543643740866 / (32)) + (0.14564446276615814 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.012707131817741 = (3.4907650362136353 - 52.405833154664464) / 3.4907650362136353 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.61345215991265 > 3.399196820668426. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.15229387686675 (T) = (0 -69.45990683419463) / Math.Sqrt((0.9753694617725747 / (33)) + (50.23597471483683 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -20.0184312421155 = (3.304714135611365 - 69.45990683419463) / 3.304714135611365 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.28527974613942 > 2.597442125618045. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.043092714295963 (T) = (0 -57.32880816241234) / Math.Sqrt((0.4269336295054914 / (32)) + (19.053184611443246 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -21.085003602128143 = (2.5958251669421526 - 57.32880816241234) / 2.5958251669421526 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.54755763366639 > 3.8151473739789874. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.28149202655399 (T) = (0 -63.53969532574456) / Math.Sqrt((0.49449496725400466 / (32)) + (13.055305288804206 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -18.425324486479862 = (3.270972146177973 - 63.53969532574456) / 3.270972146177973 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.81544813228611 > 2.853382959472732. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.01490667374131 (T) = (0 -57.713521868013416) / Math.Sqrt((0.5187707351729488 / (33)) + (5.418648070480294 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -20.564619019110975 = (2.676306120542477 - 57.713521868013416) / 2.676306120542477 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.237737802975566 > 5.126629972443748. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.42847775711876 (T) = (0 -55.36190619142795) / Math.Sqrt((1.3442247838687422 / (33)) + (5.602200798877615 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -14.126245207315149 = (3.6599899996764944 - 55.36190619142795) / 3.6599899996764944 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 84.64645386037293 > 54.36238450986203. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.136547913262043 (T) = (0 -71.10596699925429) / Math.Sqrt((2.303856117698784 / (33)) + (83.0328483038066 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.36146080291595334 = (52.227700457450375 - 71.10596699925429) / 52.227700457450375 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.56477100977908 > 2.505756406884682. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.013127533151874 (T) = (0 -59.37248959289121) / Math.Sqrt((0.6852422425688375 / (33)) + (6.311689385017626 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -23.15235094734763 = (2.458248876986089 - 59.37248959289121) / 2.458248876986089 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.47448797877879 > 3.3808478356849014. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -449.24678405751223 (T) = (0 -52.355579419461385) / Math.Sqrt((0.2443384138287217 / (33)) + (0.017716511287483607 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.018676465757862 = (3.486031511420501 - 52.355579419461385) / 3.486031511420501 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.632870279117995 > 3.6588189593492797. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -221.40498075775145 (T) = (0 -56.11363800623805) / Math.Sqrt((0.8394370228406639 / (33)) + (0.1254513551027341 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.767404735103682 = (3.3465905363851807 - 56.11363800623805) / 3.3465905363851807 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.182024537435545 > 2.3290156571751046. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.12629772324314 (T) = (0 -18.99216220269178) / Math.Sqrt((0.4727852066531933 / (33)) + (0.8510281567378244 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.428538652896038 = (2.253316142314432 - 18.99216220269178) / 2.253316142314432 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 74.76306731374966 > 56.53763452126502. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.630530586283324 (T) = (0 -74.78028965469777) / Math.Sqrt((5.633180543047497 / (31)) + (5.261099602303092 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.40540518494879746 = (53.20906060085598 - 74.78028965469777) / 53.20906060085598 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.37716749569356 > 3.395371627781076. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -70.84379931399417 (T) = (0 -58.08971214469794) / Math.Sqrt((0.6715883426118302 / (33)) + (2.3100515059714954 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -16.538610123684055 = (3.3121046499718854 - 58.08971214469794) / 3.3121046499718854 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.35897114589825 > 3.4502031913029314. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -234.46303955722743 (T) = (0 -68.48286160927636) / Math.Sqrt((0.7203808556770943 / (33)) + (0.22026783733398528 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.760340395051163 = (3.4656721615194144 - 68.48286160927636) / 3.4656721615194144 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.592818745644546 > 2.576599518540405. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.998890393033511 (T) = (0 -20.47575354058459) / Math.Sqrt((0.6872804461719033 / (33)) + (13.048819702714644 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.681220666950928 = (2.3586260879803453 - 20.47575354058459) / 2.3586260879803453 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.99645839182713 > 2.596796134442984. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.741034822445755 (T) = (0 -63.5550253284612) / Math.Sqrt((0.18864771648092668 / (32)) + (8.961352791348014 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -24.476573637434207 = (2.494645717785068 - 63.5550253284612) / 2.494645717785068 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.65757015634402 > 45.12017944717431. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.03949094285343 (T) = (0 -73.0676149698791) / Math.Sqrt((3.423357661800721 / (33)) + (1.6449942403995277 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.6752241141116169 = (43.61662081770317 - 73.0676149698791) / 43.61662081770317 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 86.99472415384776 > 2.9875217565930043. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -187.96521834517472 (T) = (0 -87.21289756654224) / Math.Sqrt((0.24582636490846355 / (32)) + (0.7774531407751887 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -31.02171891058976 = (2.723554529038741 - 87.21289756654224) / 2.723554529038741 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.972768183739504 > 3.4519283695316414. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.831775357485384 (T) = (0 -53.42953490497943) / Math.Sqrt((1.8462119182661325 / (32)) + (13.660795414230606 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.592377506785795 = (3.4266445179208187 - 53.42953490497943) / 3.4266445179208187 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.24832400510474 > 4.644406837032285. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.04922623144165 (T) = (0 -40.048072672389715) / Math.Sqrt((4.4138434081868105 / (32)) + (1.0278033226333332 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.296889045447488 = (4.826878177232482 - 40.048072672389715) / 4.826878177232482 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.35452653192235 > 3.4441097249354624. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -137.7025684241907 (T) = (0 -65.73097083884286) / Math.Sqrt((1.095540798909505 / (33)) + (0.685194762971885 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -17.997205500897657 = (3.460033678939618 - 65.73097083884286) / 3.460033678939618 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.03524834463258 > 3.5872999855581003. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -102.57488471303466 (T) = (0 -40.11862803240601) / Math.Sqrt((0.5654899212636144 / (32)) + (0.44458685374552687 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.145357868688205 = (3.303206745009576 - 40.11862803240601) / 3.303206745009576 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.66489584406934 > 3.4858849600813717. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -249.0953329539157 (T) = (0 -52.37040402085573) / Math.Sqrt((0.4043691366959301 / (33)) + (0.10511558743180832 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.07608319855444 = (3.4737407144235735 - 52.37040402085573) / 3.4737407144235735 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 86.75001749915575 > 3.5750056254565235. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -235.55519283957895 (T) = (0 -86.34124653671677) / Math.Sqrt((0.8892332325856858 / (33)) + (0.38797653051180064 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.293494039270072 = (3.4135753013271084 - 86.34124653671677) / 3.4135753013271084 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.78170738080578 > 2.3118421825104516. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.638413733184281 (T) = (0 -21.216574601310597) / Math.Sqrt((1.3051163622413053 / (33)) + (6.298305150026608 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.101859287411382 = (2.618729090281385 - 21.216574601310597) / 2.618729090281385 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 69.4078263442452 > 3.4101777705642746. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -43.019904840331606 (T) = (0 -65.60004533037745) / Math.Sqrt((0.28889068092987996 / (33)) + (8.376688999664 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.40527916681616 = (3.214856547371267 - 65.60004533037745) / 3.214856547371267 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.946254577649206 > 2.453581346900958. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.933664986993904 (T) = (0 -57.514074868754314) / Math.Sqrt((0.41575875679690716 / (32)) + (7.963531036237558 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -22.961794508128754 = (2.40024071858405 - 57.514074868754314) / 2.40024071858405 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.104158243670874 > 2.4603358795425176. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.613951360521792 (T) = (0 -30.49263849461783) / Math.Sqrt((0.8956421941298838 / (33)) + (4.693630528950172 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.561069991073532 = (2.4275510379519645 - 30.49263849461783) / 2.4275510379519645 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.720901837883662 > 0.024191148839463973. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.06863145952506 (T) = (0 -16.277800869180055) / Math.Sqrt((0.23289380195618034 / (33)) + (0.6903800544428806 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -93.16448017960718 = (0.17286561597464511 - 16.277800869180055) / 0.17286561597464511 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.788752300324266 > 2.670765689230075. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.19564418064738 (T) = (0 -21.729771052249944) / Math.Sqrt((0.7211145746447826 / (33)) + (4.822768554903933 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.114397792598955 = (2.6779277535628596 - 21.729771052249944) / 2.6779277535628596 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 92.21509554514006 > 3.462747150173568. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -90.91070447474036 (T) = (0 -90.48262630966578) / Math.Sqrt((0.7471523542069677 / (33)) + (3.566032021005814 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.403149265416854 = (3.561866497900964 - 90.48262630966578) / 3.561866497900964 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.29540570158919 > 3.4539665409088594. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.581773432319544 (T) = (0 -68.26063631349356) / Math.Sqrt((1.0755667499273578 / (33)) + (29.957592272271388 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.04232999497277 = (3.584678783085608 - 68.26063631349356) / 3.584678783085608 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).EqualsAllBenchmark.html>)	5.36 ns	31.76 ns	5.92	0.64	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).XorBenchmark.html>)	3.33 ns	48.12 ns	14.45	0.63	True
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanAnyBenchmark.html>)	2.25 ns	52.26 ns	23.22	0.64	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).SubtractBenchmark.html>)	2.70 ns	37.16 ns	13.77	0.62	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanOrEqualBenchmark.html>)	3.13 ns	71.16 ns	22.73	0.59	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).AndNotBenchmark.html>)	3.24 ns	47.05 ns	14.50	0.58	True
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).SquareRootBenchmark.html>)	31.71 ns	54.60 ns	1.72	0.59	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).ConditionalSelectBenchmark.html>)	3.50 ns	51.95 ns	14.84	0.63	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).EqualsStaticBenchmark.html>)	3.25 ns	57.08 ns	17.54	0.60	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).AddBenchmark.html>)	1.44 ns	38.34 ns	26.59	0.61	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).InequalityOperatorBenchmark.html>)	2.45 ns	21.13 ns	8.63	0.67	False
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).SumBenchmark.html>)	2.22 ns	29.56 ns	13.34	0.60	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).MinBenchmark.html>)	3.66 ns	51.75 ns	14.16	0.55	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).BitwiseAndOperatorBenchmark.html>)	3.71 ns	48.01 ns	12.96	0.61	True
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).BitwiseOrOperatorBenchmark.html>)	3.23 ns	48.18 ns	14.91	0.58	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).MaxBenchmark.html>)	3.23 ns	68.25 ns	21.15	0.59	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).MultiplyBenchmark.html>)	3.52 ns	39.72 ns	11.27	0.60	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).DotBenchmark.html>)	1.55 ns	73.05 ns	47.10	0.63	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).ZeroBenchmark.html>)	2.44 ns	16.58 ns	6.79	0.68	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanAllBenchmark.html>)	2.19 ns	49.80 ns	22.76	0.61	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).SubtractionOperatorBenchmark.html>)	3.37 ns	29.74 ns	8.82	0.57	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).ExclusiveOrOperatorBenchmark.html>)	3.27 ns	48.20 ns	14.76	0.64	True
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanBenchmark.html>)	3.35 ns	58.86 ns	17.58	0.56	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).AllBitsSetBenchmark.html>)	0.98 ns	30.22 ns	30.86	0.63	True
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanOrEqualBenchmark.html>)	3.20 ns	57.93 ns	18.09	0.55	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).DivideBenchmark.html>)	27.82 ns	49.16 ns	1.77	0.41	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanBenchmark.html>)	3.30 ns	63.38 ns	19.22	0.60	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanAnyBenchmark.html>)	0.61 ns	27.76 ns	45.88	0.67	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanOrEqualAnyBenchmark.html>)	2.35 ns	48.55 ns	20.64	0.59	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).BitwiseOrBenchmark.html>)	3.24 ns	48.00 ns	14.82	0.64	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).OnesComplementBenchmark.html>)	3.21 ns	42.15 ns	13.13	0.64	True
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanOrEqualAnyBenchmark.html>)	2.38 ns	27.47 ns	11.56	0.66	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).DivisionOperatorBenchmark.html>)	27.94 ns	39.88 ns	1.43	0.35	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).EqualsAnyBenchmark.html>)	1.60 ns	46.49 ns	29.02	0.68	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).EqualityOperatorBenchmark.html>)	2.41 ns	17.34 ns	7.19	0.69	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).AddOperatorBenchmark.html>)	3.42 ns	29.80 ns	8.71	0.54	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).CountBenchmark.html>)	0.07 ns	14.95 ns	211.80	0.91	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).OnesComplementOperatorBenchmark.html>)	5.72 ns	42.37 ns	7.41	0.58	True
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanOrEqualAllBenchmark.html>)	2.63 ns	29.54 ns	11.21	0.73	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).NegateBenchmark.html>)	23.21 ns	37.59 ns	1.62	0.53	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).BitwiseAndBenchmark.html>)	3.07 ns	47.94 ns	15.62	0.62	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).GreaterThanOrEqualAllBenchmark.html>)	2.78 ns	47.79 ns	17.21	0.64	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).AbsBenchmark.html>)	3.16 ns	49.04 ns	15.53	0.58	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int32).LessThanAllBenchmark.html>)	1.55 ns	36.46 ns	23.49	0.70	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.7622075488359 > 2.4412583946530355. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.84525621386792 (T) = (0 -29.494689084478352) / Math.Sqrt((0.7309547381182683 / (33)) + (5.568149464946906 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.673905659163408 = (2.3271980932849448 - 29.494689084478352) / 2.3271980932849448 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.11772379627208 > 3.496868304387192. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.19272365097224 (T) = (0 -49.4058449436583) / Math.Sqrt((0.7614392652860767 / (32)) + (3.860206609484949 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.232065390721795 = (3.471445892587529 - 49.4058449436583) / 3.471445892587529 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.260166354668826 > 2.512856835168981. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.34830556360571 (T) = (0 -49.64844374202263) / Math.Sqrt((0.9850814806538115 / (32)) + (6.59282858276173 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -18.471460041414314 = (2.54980590240404 - 49.64844374202263) / 2.54980590240404 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.15692747798831 > 3.4470089389929814. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.76081262456393 (T) = (0 -40.97235706862597) / Math.Sqrt((0.9475940647870016 / (33)) + (17.94294221822125 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.663225761980671 = (3.2355387038616166 - 40.97235706862597) / 3.2355387038616166 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 71.15599181967238 > 3.4310272577617695. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.633829748617508 (T) = (0 -70.31590823451506) / Math.Sqrt((0.8058924676913976 / (33)) + (64.71053994870057 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.916231150498014 = (3.3617867257524954 - 70.31590823451506) / 3.3617867257524954 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.046280667988285 > 3.5148924330184474. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.2285163710776 (T) = (0 -49.45109155233055) / Math.Sqrt((1.1604001842066844 / (33)) + (10.31031918676419 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.936622367714737 = (3.82256590218967 - 49.45109155233055) / 3.82256590218967 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.59770268332848 > 30.450902028300952. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.87269536770361 (T) = (0 -51.95861980767614) / Math.Sqrt((4.3607940293178995 / (32)) + (8.188140411496429 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7329542499261217 = (29.98268408406697 - 51.95861980767614) / 29.98268408406697 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.95194730405099 > 3.6732088064302335. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -99.11045578781092 (T) = (0 -52.06965324096571) / Math.Sqrt((1.2474176468487994 / (33)) + (0.8029670095896032 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.213777706620059 = (3.6633226096334894 - 52.06965324096571) / 3.6633226096334894 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.07859850158415 > 3.441546847185951. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.882938868155282 (T) = (0 -58.34685063132129) / Math.Sqrt((0.7987598197493073 / (33)) + (22.916727805596835 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -15.866501120803218 = (3.4593333978056675 - 58.34685063132129) / 3.4593333978056675 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 38.33840650288769 > 3.403584115605923. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.342054214529934 (T) = (0 -40.71788088307285) / Math.Sqrt((0.28811775179993865 / (32)) + (7.388209725300373 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.741550213172639 = (3.46784539893141 - 40.71788088307285) / 3.46784539893141 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.13259029173193 > 2.5543075965156383. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.04660495785312 (T) = (0 -19.689515872106448) / Math.Sqrt((0.40610576539695764 / (33)) + (3.9857234237584187 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.665454036684927 = (2.568603996303076 - 19.689515872106448) / 2.568603996303076 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.564141542130148 > 2.27795195472081. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.996694132824956 (T) = (0 -32.17769973807548) / Math.Sqrt((0.349895519395579 / (33)) + (7.418504798581554 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.063980934534978 = (2.13606880398437 - 32.17769973807548) / 2.13606880398437 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.74661387421294 > 3.986595087985922. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.844061716652654 (T) = (0 -53.931823692209235) / Math.Sqrt((0.5582446289556245 / (33)) + (6.014209702492355 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.114932013905898 = (3.5681155325469796 - 53.931823692209235) / 3.5681155325469796 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.01024470614651 > 3.882891868158047. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -134.11595503087543 (T) = (0 -48.605712745211235) / Math.Sqrt((2.17944649217429 / (31)) + (0.16665936582806914 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -12.037916052298089 = (3.728027742335701 - 48.605712745211235) / 3.728027742335701 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.182172901889615 > 4.076489498500848. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -200.13483498943316 (T) = (0 -48.58368112956272) / Math.Sqrt((0.9020422551591246 / (33)) + (0.09205830573405878 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.215821844438555 = (3.6761755493857216 - 48.58368112956272) / 3.6761755493857216 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 68.25172737951182 > 3.510760789520413. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.15200827527403 (T) = (0 -60.95227354456512) / Math.Sqrt((0.1466290299159538 / (32)) + (32.65397605728183 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.15058613702538 = (3.358143537867826 - 60.95227354456512) / 3.358143537867826 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.716412049107944 > 3.6336893615345587. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.685095388240644 (T) = (0 -40.677331084073444) / Math.Sqrt((1.5324692959280108 / (33)) + (21.82268076736128 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.469086375374392 = (3.885470959505648 - 40.677331084073444) / 3.885470959505648 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 73.051337953901 > 2.751468174572857. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.97438174687598 (T) = (0 -68.67674002502588) / Math.Sqrt((1.1081538563060829 / (33)) + (10.193188940522507 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -23.197347748369985 = (2.8381928771368 - 68.67674002502588) / 2.8381928771368 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.57563757169654 > 2.1165800648120014. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -53.37261704990198 (T) = (0 -16.433173701350754) / Math.Sqrt((0.5694308220590133 / (32)) + (0.22239122496629282 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.324938765450358 = (1.9739693184952527 - 16.433173701350754) / 1.9739693184952527 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.80240513845279 > 2.385249983950792. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.356996828855422 (T) = (0 -49.09293763711743) / Math.Sqrt((0.8002223556496721 / (32)) + (14.636103957874694 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -19.95731546677557 = (2.342520334483982 - 49.09293763711743) / 2.342520334483982 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.741423054424725 > 3.5366158873171214. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.42842347784913 (T) = (0 -30.2784989044722) / Math.Sqrt((0.6074285233036673 / (32)) + (1.0125241395894349 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.773489646128163 = (3.451135195427561 - 30.2784989044722) / 3.451135195427561 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.202337558605564 > 3.4348060276344343. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.40375324928095 (T) = (0 -47.045604288887645) / Math.Sqrt((0.6525076979046252 / (33)) + (4.352615288116401 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.578159190160163 = (3.4647998767742183 - 47.045604288887645) / 3.4647998767742183 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 58.855126753448786 > 3.6106385069754086. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.276929940845505 (T) = (0 -57.66704888558859) / Math.Sqrt((0.3032052809006153 / (31)) + (4.273918157774076 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -16.045913708800015 = (3.38304240363588 - 57.66704888558859) / 3.38304240363588 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.21665401797062 > 2.069373002134448. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.39365967630921 (T) = (0 -30.92027125424331) / Math.Sqrt((0.25752856450379974 / (33)) + (2.497715982996343 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.596183070480024 = (1.9825537514219265 - 30.92027125424331) / 1.9825537514219265 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.929080212550616 > 3.3799058423822617. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.871052435102298 (T) = (0 -62.27710185522325) / Math.Sqrt((0.5232214140384227 / (31)) + (117.83138970039118 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -18.11822602603007 = (3.2574728309222314 - 62.27710185522325) / 3.2574728309222314 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.15599539316558 > 28.891199374139198. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.004075589498484 (T) = (0 -50.299663143664745) / Math.Sqrt((2.0524883524295197 / (33)) + (0.6832383696172363 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.7904590351055198 = (28.093166142000204 - 50.299663143664745) / 28.093166142000204 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 63.383910412635124 > 3.5853997043618167. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.37750081269308 (T) = (0 -70.67460566349759) / Math.Sqrt((0.6017647656960001 / (33)) + (66.96758275667568 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.48823094956414 = (3.6265275101883088 - 70.67460566349759) / 3.6265275101883088 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.761464158365808 > 2.676094641670858. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.64982267131797 (T) = (0 -30.33235655936381) / Math.Sqrt((0.839051048836852 / (32)) + (6.961243408120731 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.508395904278332 = (2.8864877984863946 - 30.33235655936381) / 2.8864877984863946 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.55326659431321 > 2.539618452786322. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.98067546116207 (T) = (0 -46.49513080520301) / Math.Sqrt((0.5678676377501636 / (32)) + (4.771582017051243 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -17.562903535310856 = (2.504733740427984 - 46.49513080520301) / 2.504733740427984 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.9997329275913 > 3.4272568547535927. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -70.20059652781708 (T) = (0 -48.94762744363484) / Math.Sqrt((1.4400989180256962 / (33)) + (1.511294640996713 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.51043254746474 = (3.3732714227176475 - 48.94762744363484) / 3.3732714227176475 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.146920698752936 > 3.3694747649035515. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.863755086509766 (T) = (0 -45.72445607320071) / Math.Sqrt((0.4319983392997699 / (32)) + (22.594280379001333 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.211334436502138 = (3.2174639389075526 - 45.72445607320071) / 3.2174639389075526 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.470150414388108 > 2.6015802224476148. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.77346096892285 (T) = (0 -28.56218710129619) / Math.Sqrt((0.4446305760408435 / (32)) + (8.593259816478731 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.76714209400921 = (2.4272832666682533 - 28.56218710129619) / 2.4272832666682533 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.87975982737216 > 29.77676857585975. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.23129047122824 (T) = (0 -38.26174777332832) / Math.Sqrt((2.516150825272248 / (32)) + (1.2129282491175344 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.32624986690164226 = (28.849577088150536 - 38.26174777332832) / 28.849577088150536 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.48950580852444 > 2.517851286838141. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.227187305474054 (T) = (0 -48.58078640344513) / Math.Sqrt((1.2636939770241475 / (33)) + (7.921501259614701 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -16.397258752308613 = (2.7924391477478294 - 48.58078640344513) / 2.7924391477478294 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.342358710981447 > 2.729532084259044. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.888167180910347 (T) = (0 -19.258978068132237) / Math.Sqrt((0.444994982165539 / (32)) + (5.102976296109403 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.189860218069852 = (2.3515637086991825 - 19.258978068132237) / 2.3515637086991825 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.79878402808313 > 3.5313088888131414. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.421466211550175 (T) = (0 -32.31396179090228) / Math.Sqrt((1.6600665386080358 / (32)) + (9.666408193910202 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.585101206870013 = (3.371269754328897 - 32.31396179090228) / 3.371269754328897 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.952885012627053 > 0.04663383566137861. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.03177855466334 (T) = (0 -15.239114459009144) / Math.Sqrt((0.18828445214424944 / (33)) + (0.2847936304279344 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -58.70176415099708 = (0.25525400590284963 - 15.239114459009144) / 0.25525400590284963 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.37438982932377 > 6.117126419509326. IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.381037612359485 (T) = (0 -44.09133328871783) / Math.Sqrt((0.702525803145745 / (32)) + (12.559279983486297 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.26033908880028 = (6.072902759697909 - 44.09133328871783) / 6.072902759697909 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.536724233027034 > 2.6534080445952934. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.884320644801004 (T) = (0 -31.933400272797698) / Math.Sqrt((0.7985774643285978 / (33)) + (17.80094335942637 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.45408604027469 = (2.564090224648341 - 31.933400272797698) / 2.564090224648341 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.59366759067448 > 24.189845394997715. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.060813676234693 (T) = (0 -40.39325715999899) / Math.Sqrt((2.5752839767085813 / (33)) + (8.847663832048905 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -0.7647898125524643 = (22.888423807012522 - 40.39325715999899) / 22.888423807012522 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.944623520186305 > 3.321220779188008. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -73.72067576872382 (T) = (0 -49.158231545087425) / Math.Sqrt((0.702646003724261 / (32)) + (1.4686753260806065 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.501121638317972 = (3.1712693243804253 - 49.158231545087425) / 3.1712693243804253 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.79119159382257 > 2.8952480461392778. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.33508849873114 (T) = (0 -48.093410615259394) / Math.Sqrt((0.5442263965087843 / (33)) + (12.908266424223735 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.508798274608424 = (2.4652164596860446 - 48.093410615259394) / 2.4652164596860446 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.0376691095202 > 3.4404515584461848. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.896499912996312 (T) = (0 -50.76533252223866) / Math.Sqrt((0.5468938975988233 / (33)) + (8.811015841715877 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.630550646227784 = (3.2478275187630814 - 50.76533252223866) / 3.2478275187630814 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 36.46334691832986 > 2.354341701733737. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.109331285308645 (T) = (0 -33.16752325261094) / Math.Sqrt((0.6184583421914687 / (31)) + (14.641529987134513 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -13.655982868439677 = (2.2630705528480233 - 33.16752325261094) / 2.2630705528480233 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).BitwiseAndBenchmark.html>)	2.80 ns	48.21 ns	17.19	0.58	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanOrEqualAnyBenchmark.html>)	2.34 ns	48.30 ns	20.62	0.64	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).NegateBenchmark.html>)	17.88 ns	40.41 ns	2.26	0.60	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).EqualityOperatorBenchmark.html>)	2.33 ns	20.46 ns	8.79	0.69	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanOrEqualAllBenchmark.html>)	0.86 ns	27.29 ns	31.90	0.69	False
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).SumBenchmark.html>)	0.00 ns	27.09 ns	∞	0.85	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).CountBenchmark.html>)	0.00 ns	15.03 ns	∞	0.93	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).AddOperatorBenchmark.html>)	3.27 ns	22.58 ns	6.90	0.66	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanAnyBenchmark.html>)	2.71 ns	40.81 ns	15.05	0.63	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanBenchmark.html>)	3.44 ns	51.26 ns	14.91	0.69	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).ZeroBenchmark.html>)	2.04 ns	16.51 ns	8.09	0.65	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanOrEqualBenchmark.html>)	4.33 ns	40.26 ns	9.29	0.65	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).AbsBenchmark.html>)	2.89 ns	44.79 ns	15.52	0.60	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanAllBenchmark.html>)	2.12 ns	35.84 ns	16.91	0.71	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanAllBenchmark.html>)	1.23 ns	27.87 ns	22.65	0.71	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).XorBenchmark.html>)	5.63 ns	48.22 ns	8.56	0.62	True
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).DivisionOperatorBenchmark.html>)	24.77 ns	31.83 ns	1.28	0.44	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanOrEqualBenchmark.html>)	3.16 ns	50.79 ns	16.05	0.66	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanAnyBenchmark.html>)	2.49 ns	25.33 ns	10.17	0.69	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).BitwiseAndOperatorBenchmark.html>)	3.68 ns	48.03 ns	13.06	0.62	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).ConditionalSelectBenchmark.html>)	3.10 ns	53.35 ns	17.22	0.59	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).BitwiseOrBenchmark.html>)	3.29 ns	48.39 ns	14.70	0.57	True
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).UnaryNegateOperatorBenchmark.html>)	14.17 ns	28.29 ns	2.00	0.53	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).EqualsStaticBenchmark.html>)	3.40 ns	45.75 ns	13.46	0.60	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).OnesComplementOperatorBenchmark.html>)	5.64 ns	43.19 ns	7.66	0.59	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanOrEqualAllBenchmark.html>)	2.54 ns	39.84 ns	15.67	0.64	False
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).DivideBenchmark.html>)	25.18 ns	41.63 ns	1.65	0.46	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).EqualsAllBenchmark.html>)	2.10 ns	34.15 ns	16.27	0.66	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).SubtractionOperatorBenchmark.html>)	3.19 ns	22.14 ns	6.94	0.60	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).AllBitsSetBenchmark.html>)	1.95 ns	29.54 ns	15.15	0.67	True
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).LessThanBenchmark.html>)	3.16 ns	43.06 ns	13.63	0.65	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).BitwiseOrOperatorBenchmark.html>)	3.24 ns	48.59 ns	14.99	0.61	True
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).MultiplyBenchmark.html>)	3.38 ns	35.73 ns	10.57	0.65	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).ExclusiveOrOperatorBenchmark.html>)	3.21 ns	49.08 ns	15.31	0.58	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).SubtractBenchmark.html>)	4.46 ns	29.84 ns	6.69	0.58	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).MaxBenchmark.html>)	3.20 ns	47.17 ns	14.74	0.57	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).AndNotBenchmark.html>)	3.41 ns	47.80 ns	14.03	0.60	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).MinBenchmark.html>)	3.61 ns	40.59 ns	11.25	0.65	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).GreaterThanOrEqualAnyBenchmark.html>)	1.05 ns	35.48 ns	33.73	0.64	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).EqualsAnyBenchmark.html>)	2.44 ns	43.65 ns	17.87	0.66	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).AddBenchmark.html>)	3.28 ns	31.77 ns	9.69	0.60	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).InequalityOperatorBenchmark.html>)	2.25 ns	17.43 ns	7.74	0.66	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).OnesComplementBenchmark.html>)	3.16 ns	49.20 ns	15.55	0.59	True
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).SquareRootBenchmark.html>)	22.14 ns	39.61 ns	1.79	0.65	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).MultiplyOperatorBenchmark.html>)	3.28 ns	27.21 ns	8.30	0.69	False
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Int64).DotBenchmark.html>)	2.50 ns	45.00 ns	18.02	0.86	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.21248836981016 > 3.430037758928495. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.467371741305975 (T) = (0 -49.808499269523665) / Math.Sqrt((0.6291625506490318 / (33)) + (3.284815036578516 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.04252716171042 = (3.546975462175773 - 49.808499269523665) / 3.546975462175773 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.29900863555171 > 2.4136006674759063. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.073326651454845 (T) = (0 -43.863334479458956) / Math.Sqrt((0.1719094364232937 / (33)) + (21.223399770458375 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -18.829505336639905 = (2.2120236352245572 - 43.863334479458956) / 2.2120236352245572 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.40988071273894 > 16.879206138876366. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.061513661161273 (T) = (0 -34.94240669596507) / Math.Sqrt((5.245273789357695 / (32)) + (17.21749389813166 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -1.2132419659798164 = (15.787883671587549 - 34.94240669596507) / 15.787883671587549 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.462711598414078 > 2.2441005945412678. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.09500554109243 (T) = (0 -21.26656988512475) / Math.Sqrt((0.3230054631406184 / (33)) + (4.922287296282387 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.546787705035301 = (2.227615250510707 - 21.26656988512475) / 2.227615250510707 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.287641250642746 > 2.759801040105637. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.607260642393571 (T) = (0 -28.456388628358305) / Math.Sqrt((0.5463024086388586 / (32)) + (12.609694287455264 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.610255942296465 = (2.4509699673967513 - 28.456388628358305) / 2.4509699673967513 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.0905472867852 > 2.005324305625231. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.11554992226115 (T) = (0 -26.330205863630848) / Math.Sqrt((2.482320150891186 / (31)) + (3.380830421775435 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -11.12727617733952 = (2.171155787878426 - 26.330205863630848) / 2.171155787878426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.034026110416061 > 0.08172371738931077. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.19032113831584 (T) = (0 -15.660443528090264) / Math.Sqrt((0.2854110256748583 / (33)) + (0.8080845463354955 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -57.14058582749458 = (0.2693547597637805 - 15.660443528090264) / 0.2693547597637805 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.58111646625137 > 3.4673347078802226. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.489279691287424 (T) = (0 -24.921311472948563) / Math.Sqrt((0.5283936391514964 / (33)) + (8.598755566970747 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.925619471547692 = (3.5984234443333216 - 24.921311472948563) / 3.5984234443333216 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.814876915953654 > 2.7806998968205234. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.891617633429973 (T) = (0 -41.48389240555588) / Math.Sqrt((0.8649385405275989 / (33)) + (8.187812035732835 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.008420656216657 = (2.764041157679891 - 41.48389240555588) / 2.764041157679891 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.26482253671125 > 3.355760112519427. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -55.0682045162375 (T) = (0 -50.49398639744951) / Math.Sqrt((0.23705340903589986 / (33)) + (2.8943241253187346 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.76837245810862 = (3.4190623605057873 - 50.49398639744951) / 3.4190623605057873 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.50637224360829 > 1.9821639701504281. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -91.67443430324604 (T) = (0 -16.678824998277484) / Math.Sqrt((0.4102477804487699 / (33)) + (0.052323582653544996 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.192109650924428 = (2.035962128069829 - 16.678824998277484) / 2.035962128069829 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.25550446684632 > 3.8363553076761714. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.076136230503671 (T) = (0 -47.0378461664603) / Math.Sqrt((0.7176812031143505 / (33)) + (43.78859204249445 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.60876425143983 = (3.730567502766095 - 47.0378461664603) / 3.730567502766095 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.787298260291685 > 3.6105024471650666. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.814167057884305 (T) = (0 -43.717980444646855) / Math.Sqrt((2.1992618170694316 / (31)) + (6.453624617233003 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -10.731394937792286 = (3.7265798889619584 - 43.717980444646855) / 3.7265798889619584 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.84399222444126 > 2.5662922020987238. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.46216497068325 (T) = (0 -38.0177223835798) / Math.Sqrt((0.2153430291757202 / (33)) + (5.428802292406723 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.552944080273969 = (2.44440680731298 - 38.0177223835798) / 2.44440680731298 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.868001712022185 > 2.430440741398741. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -66.41632564172255 (T) = (0 -28.581005774954548) / Math.Sqrt((0.5072837300804312 / (33)) + (0.5616990386770159 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.081247847409415 = (2.3657329222894123 - 28.581005774954548) / 2.3657329222894123 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.22192166047947 > 3.4006289386521518. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -175.7341233186341 (T) = (0 -48.454042387225996) / Math.Sqrt((0.9218634857416138 / (32)) + (0.14608895063872832 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.700331352990343 = (3.536705875121045 - 48.454042387225996) / 3.536705875121045 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.826342984747725 > 27.047622302695228. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.028685507923081 (T) = (0 -33.92059705276907) / Math.Sqrt((2.833107456820744 / (33)) + (4.803183006482829 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.30725663278392057 = (25.94792499199802 - 33.92059705276907) / 25.94792499199802 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.785074027398984 > 3.3334866473439533. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -82.68714611081496 (T) = (0 -50.90220338482954) / Math.Sqrt((1.0038882669565456 / (33)) + (0.9010520213304619 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -14.210307735027715 = (3.346559732490303 - 50.90220338482954) / 3.346559732490303 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.33414373194071 > 2.713072253268462. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.473729313240856 (T) = (0 -28.978436443326956) / Math.Sqrt((0.915290973318642 / (33)) + (6.570385442609627 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.508906809552407 = (2.5179139011947527 - 28.978436443326956) / 2.5179139011947527 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.02882479078164 > 3.469947222257438. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.64032761405977 (T) = (0 -49.31338253368398) / Math.Sqrt((0.5119947372306745 / (33)) + (3.9804954865264843 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.373238393544638 = (3.4309166232038417 - 49.31338253368398) / 3.4309166232038417 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.34822044963487 > 3.486446522372383. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.63036640226962 (T) = (0 -53.48225332869926) / Math.Sqrt((0.5284891460885269 / (32)) + (3.813198196759927 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.766413737057569 = (3.621885061670797 - 53.48225332869926) / 3.621885061670797 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.38655574746729 > 3.495126416788097. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -66.65928883651551 (T) = (0 -49.01109745021479) / Math.Sqrt((1.3177094016025237 / (32)) + (1.686172653077431 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.365368814124924 = (3.667021698527196 - 49.01109745021479) / 3.667021698527196 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.29465508925455 > 14.967111149967923. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.774688783714144 (T) = (0 -23.11502452416807) / Math.Sqrt((1.6754837918376084 / (31)) + (12.602112545206078 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.5867315799871087 = (14.567696777268319 - 23.11502452416807) / 14.567696777268319 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.74609473677939 > 3.506880345596644. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.397220912858923 (T) = (0 -42.794684825916114) / Math.Sqrt((0.7042979227391284 / (33)) + (8.419405677390209 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -11.405360320301622 = (3.449693013421122 - 42.794684825916114) / 3.449693013421122 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.18867690941157 > 6.036327324652051. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.34573556160129 (T) = (0 -44.26847439420847) / Math.Sqrt((0.869315128198125 / (33)) + (11.579294492599743 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.285266737657029 = (6.07643837738814 - 44.26847439420847) / 6.07643837738814 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.83883161018113 > 2.7194499551475357. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.356155555308156 (T) = (0 -43.06358240828281) / Math.Sqrt((0.9531418796332048 / (32)) + (11.69802426016596 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.753370863061262 = (2.918897844295585 - 43.06358240828281) / 2.918897844295585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.626311449387224 > 26.502503391777758. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.955329086456777 (T) = (0 -47.44651294712619) / Math.Sqrt((3.9013243769731516 / (33)) + (15.343904794772621 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.8489261341592885 = (25.66165952795093 - 47.44651294712619) / 25.66165952795093 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.14609910587936 > 2.4127170167755634. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.401391759813764 (T) = (0 -30.12671544702159) / Math.Sqrt((0.43092142881524803 / (32)) + (17.29748979823803 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.60125584105719 = (2.214995129793832 - 30.12671544702159) / 2.214995129793832 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.136499633787622 > 3.5261929900890814. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -43.24810052952768 (T) = (0 -22.695448534569866) / Math.Sqrt((0.4589097582440627 / (32)) + (0.730706968619398 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.486163896260151 = (3.4990556664249275 - 22.695448534569866) / 3.4990556664249275 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.543852526078517 > 2.046276814872458. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -132.24335056309422 (T) = (0 -29.444122322890998) / Math.Sqrt((0.0946824364193046 / (32)) + (0.16021866300282706 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.596127896926424 = (2.017255708556184 - 29.444122322890998) / 2.017255708556184 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.05964400946638 > 3.352969938438453. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.21707824034874 (T) = (0 -47.62427222540088) / Math.Sqrt((0.5904076469897173 / (33)) + (23.57784581261979 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.306541862608327 = (3.328845830303128 - 47.62427222540088) / 3.328845830303128 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.5944462677554 > 3.518476449437134. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.37814976221478 (T) = (0 -49.85242993051298) / Math.Sqrt((0.42398563903832137 / (32)) + (2.8516663205115154 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.187280854997791 = (3.5138819369288328 - 49.85242993051298) / 3.5138819369288328 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.72992227909337 > 3.5945222237721195. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.337905035160425 (T) = (0 -35.00734411047742) / Math.Sqrt((0.6469092552605812 / (32)) + (2.6200185806797545 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.989553119924585 = (3.5043954109072004 - 35.00734411047742) / 3.5043954109072004 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.07652645329061 > 3.5244465681315855. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.76807546184731 (T) = (0 -49.47477828956363) / Math.Sqrt((1.995400341058667 / (32)) + (4.818748135229531 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.800487151742766 = (3.5850023079305435 - 49.47477828956363) / 3.5850023079305435 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.84436007889304 > 3.7161780348128564. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.03543068720879 (T) = (0 -32.52411511047291) / Math.Sqrt((1.8344425341255302 / (31)) + (8.907634975834974 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.689503952014207 = (3.742919652270127 - 32.52411511047291) / 3.742919652270127 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.172160936033904 > 3.621275466258878. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.254719718536144 (T) = (0 -44.648263670135606) / Math.Sqrt((0.5928640517792803 / (33)) + (11.597954378981944 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.866557184512287 = (3.2198521288329416 - 44.648263670135606) / 3.2198521288329416 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.79657599868863 > 3.5255224735549366. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -60.17569907852571 (T) = (0 -49.03376387967983) / Math.Sqrt((1.7915512107312472 / (31)) + (2.0341671757128 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -12.08107392542987 = (3.7484509421170085 - 49.03376387967983) / 3.7484509421170085 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.59271912807753 > 3.6891999554841215. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.08161233971077 (T) = (0 -41.613426294348905) / Math.Sqrt((1.2745235915453887 / (32)) + (2.139926116504506 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.421511873691667 = (3.643425384882833 - 41.613426294348905) / 3.643425384882833 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.47716374704074 > 2.445166404891522. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.341632230196485 (T) = (0 -30.61859754336625) / Math.Sqrt((0.3368793679902771 / (33)) + (13.407908207961748 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.30761467469798 = (2.487776742500074 - 30.61859754336625) / 2.487776742500074 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.64744618217946 > 2.580651582392824. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.55874327980773 (T) = (0 -43.48841897456444) / Math.Sqrt((0.629055463020687 / (32)) + (17.339768442399347 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.264271116410022 = (2.6738621524014254 - 43.48841897456444) / 2.6738621524014254 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.77130043776608 > 3.535176174466671. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.017202572141596 (T) = (0 -34.49758744510995) / Math.Sqrt((0.3487634379344482 / (32)) + (26.681013892362444 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.041176137360136 = (3.4356122204404933 - 34.49758744510995) / 3.4356122204404933 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.429272351585745 > 2.9201313843152312. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.967405673771673 (T) = (0 -19.027713464630246) / Math.Sqrt((0.9074765536670152 / (32)) + (2.572595612085341 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.139023787485408 = (2.665310276453416 - 19.027713464630246) / 2.665310276453416 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.203938458087464 > 3.167328351780043. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.503541405203833 (T) = (0 -46.05793293774937) / Math.Sqrt((1.338948200529545 / (33)) + (8.170250258707163 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.253134922585238 = (3.4752481738686645 - 46.05793293774937) / 3.4752481738686645 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.6076569610634 > 22.238046387373814. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.61820880565701 (T) = (0 -39.3955804477245) / Math.Sqrt((8.708793562257041 / (32)) + (5.036810600535911 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7475482807664801 = (22.543343083171056 - 39.3955804477245) / 22.543343083171056 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.207495381970777 > 3.5466884988291705. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.958743020976803 (T) = (0 -23.51753404824796) / Math.Sqrt((0.7790984303379895 / (32)) + (6.060301676495218 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -5.32707113865247 = (3.716970069228064 - 23.51753404824796) / 3.716970069228064 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.9991283572535 > 2.8196554131383986. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.88436478026709 (T) = (0 -47.086493058857315) / Math.Sqrt((3.0678977855130256 / (33)) + (21.02390079009004 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.80369731160541 = (3.4111507950315247 - 47.086493058857315) / 3.4111507950315247 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToStringD - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678.html>)	1.00 μs	1.55 μs	1.54	0.00	True
[GreatestCommonDivisor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments%3a%2065536%2c65536%20bits).html>)	5.34 ms	5.91 ms	1.11	0.00	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.550587872513803 > 1.0561512023047324. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -49.08046687840223 (T) = (0 -1543.573993807113) / Math.Sqrt((126.23574423311582 / (32)) + (465.3920455615491 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.5354839760270143 = (1005.2687086979777 - 1543.573993807113) / 1005.2687086979777 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 65536,65536 bits) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 5.914994059523809 > 5.653454756586539. IsChangePoint: Marked as a change because one of 4/12/2023 9:47:42 AM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.634360647686275 (T) = (0 -5830889.898207199) / Math.Sqrt((2285511846.306647 / (31)) + (1700562080.4686942 / (6))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (6) - 2, .025) and -0.08677038480123925 = (5365337.4988439875 - 5830889.898207199) / 5365337.4988439875 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).OnesComplementOperatorBenchmark.html>)	5.15 ns	41.65 ns	8.09	0.66	True
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).InequalityOperatorBenchmark.html>)	2.51 ns	18.80 ns	7.48	0.69	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).EqualityOperatorBenchmark.html>)	2.31 ns	20.20 ns	8.76	0.69	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanAnyBenchmark.html>)	2.39 ns	19.67 ns	8.22	0.68	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseOrOperatorBenchmark.html>)	3.44 ns	52.00 ns	15.10	0.63	True
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).NegateBenchmark.html>)	3.27 ns	121.95 ns	37.29	0.44	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).OneBenchmark.html>)	2.79 ns	34.39 ns	12.32	0.65	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).AbsBenchmark.html>)	3.23 ns	108.26 ns	33.54	0.43	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).ConditionalSelectBenchmark.html>)	3.62 ns	175.93 ns	48.58	0.62	True
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).ExclusiveOrOperatorBenchmark.html>)	3.34 ns	78.05 ns	23.37	0.61	True
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).CountBenchmark.html>)	0.00 ns	15.04 ns	∞	0.89	True
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).XorBenchmark.html>)	3.45 ns	52.74 ns	15.30	0.65	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseAndBenchmark.html>)	3.37 ns	54.82 ns	16.27	0.51	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanAllBenchmark.html>)	2.32 ns	18.92 ns	8.16	0.69	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).EqualsAllBenchmark.html>)	2.02 ns	29.26 ns	14.46	0.71	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).AndNotBenchmark.html>)	3.19 ns	91.50 ns	28.64	0.62	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).OnesComplementBenchmark.html>)	3.21 ns	39.14 ns	12.21	0.62	True
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).UnaryNegateOperatorBenchmark.html>)	4.89 ns	113.88 ns	23.31	0.51	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).ZeroBenchmark.html>)	2.59 ns	16.31 ns	6.29	0.65	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).LessThanOrEqualAnyBenchmark.html>)	2.39 ns	18.61 ns	7.78	0.68	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseAndOperatorBenchmark.html>)	3.33 ns	52.22 ns	15.67	0.59	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).GreaterThanOrEqualAllBenchmark.html>)	4.02 ns	18.81 ns	4.68	0.70	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseOrBenchmark.html>)	3.29 ns	56.37 ns	17.13	0.58	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;SByte&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.65032106008908 > 5.514828119374135. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -110.81551371913301 (T) = (0 -40.86778305689977) / Math.Sqrt((0.9666764877783556 / (33)) + (0.3025260390537899 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.219050193397992 = (4.972324306977355 - 40.86778305689977) / 4.972324306977355 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.79530215986756 > 2.7249463589731486. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.509391210427355 (T) = (0 -21.09235791082847) / Math.Sqrt((0.7891062669514115 / (32)) + (5.431092633080877 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.382961612660059 = (2.856896597519888 - 21.09235791082847) / 2.856896597519888 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.20368086094585 > 2.581886933134036. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -34.25414102069548 (T) = (0 -19.250154842403166) / Math.Sqrt((0.30799233625861155 / (32)) + (0.6948613318840948 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -6.936098021149973 = (2.4256447930835585 - 19.250154842403166) / 2.4256447930835585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.66715528763677 > 2.5884728337437015. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.14956950235417 (T) = (0 -20.90510934590935) / Math.Sqrt((0.9546935199203037 / (32)) + (4.981424268891942 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.8345657650123295 = (2.6683175523610467 - 20.90510934590935) / 2.6683175523610467 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.99788248375809 > 3.575003262474398. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -95.2053744365312 (T) = (0 -52.81879755635224) / Math.Sqrt((0.4841222730938078 / (33)) + (1.0207492902470043 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.712059819445516 = (3.3616723818084493 - 52.81879755635224) / 3.3616723818084493 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 121.95109747910003 > 3.410689853528251. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -72.73863811725357 (T) = (0 -127.03960101552697) / Math.Sqrt((0.316020245452366 / (33)) + (11.541437136414311 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -37.750851810548156 = (3.2783692507359596 - 127.03960101552697) / 3.2783692507359596 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.38706101986002 > 2.228817745634509. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.35698709208623 (T) = (0 -34.24319266301655) / Math.Sqrt((0.43921797712739163 / (31)) + (7.503410274702525 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -15.058019165659681 = (2.132466794923632 - 34.24319266301655) / 2.132466794923632 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 108.25650120232562 > 3.4897630539623963. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -95.58539990627375 (T) = (0 -106.05480647278527) / Math.Sqrt((0.9828395958256886 / (32)) + (4.467673086680355 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -28.004672460956474 = (3.6564731636099967 - 106.05480647278527) / 3.6564731636099967 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 175.92807657415926 > 3.7841358304426165. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -120.59501330230394 (T) = (0 -177.46153593351463) / Math.Sqrt((1.2267720927514667 / (33)) + (8.157763707098246 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -47.2431747266266 = (3.6784796386040743 - 177.46153593351463) / 3.6784796386040743 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 78.05019642721444 > 3.564423372735815. IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.550439591064164 (T) = (0 -58.65737474596405) / Math.Sqrt((0.2769798933615363 / (32)) + (167.21625462536431 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -16.416724221982175 = (3.3678764156999628 - 58.65737474596405) / 3.3678764156999628 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.036276548400517 > 0.06979831032816715. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.385000001436154 (T) = (0 -14.733651820152987) / Math.Sqrt((0.22330311477704795 / (31)) + (0.3614149128915403 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -58.96527046036065 = (0.24570308291851195 - 14.733651820152987) / 0.24570308291851195 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.739770585964116 > 3.593614423176376. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -60.42274371336415 (T) = (0 -53.02854160991858) / Math.Sqrt((1.331112964981562 / (32)) + (2.5055427493001443 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.548706913119277 = (3.6448972356505553 - 53.02854160991858) / 3.6448972356505553 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 54.821234640138705 > 3.401786132669277. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -61.73003405200236 (T) = (0 -54.46471238598309) / Math.Sqrt((0.6156145101825141 / (33)) + (2.650340169362233 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.49745264488829 = (3.5144299927219227 - 54.46471238598309) / 3.5144299927219227 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.92332544172491 > 2.3914629434943886. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.260944266848828 (T) = (0 -19.749518157878168) / Math.Sqrt((0.43161117599781046 / (33)) + (1.5743104639770358 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.349648946856802 = (2.365311198540007 - 19.749518157878168) / 2.365311198540007 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.262078288846322 > 2.476076581334393. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.93755672581552 (T) = (0 -30.22987719942169) / Math.Sqrt((1.0401705250478297 / (32)) + (3.3147775724699406 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.350970692323653 = (2.4475709604112406 - 30.22987719942169) / 2.4475709604112406 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 91.49744899943786 > 3.463065847041594. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -59.041534749906 (T) = (0 -87.33617150540718) / Math.Sqrt((0.7628700013558776 / (33)) + (7.982141634428672 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.31209109118925 = (3.4503736254255015 - 87.33617150540718) / 3.4503736254255015 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.13840067381718 > 3.4130569813393263. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -159.25430379757134 (T) = (0 -39.61480841565415) / Math.Sqrt((0.510480002525994 / (33)) + (0.1437791283936639 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.304020731106108 = (3.504488301816641 - 39.61480841565415) / 3.504488301816641 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 113.88440715873791 > 3.6869211575211036. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.13423960925297 (T) = (0 -115.31607756175484) / Math.Sqrt((1.0764575133224579 / (33)) + (25.62987579383441 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -33.784463366069325 = (3.3151604596620134 - 115.31607756175484) / 3.3151604596620134 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.307303371719794 > 2.147120618555231. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -112.74977057509523 (T) = (0 -16.545836662544588) / Math.Sqrt((0.2732054276178578 / (32)) + (0.0312564006231979 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.7750502261516665 = (2.1280681386329903 - 16.545836662544588) / 2.1280681386329903 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.613555991734394 > 2.511549528100757. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.018996700937695 (T) = (0 -20.20649353984058) / Math.Sqrt((0.8703829142496944 / (33)) + (3.3175363263964357 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.734422342383111 = (2.612540749050252 - 20.20649353984058) / 2.612540749050252 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.217561168574925 > 3.4442807525251715. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -53.52464262652784 (T) = (0 -53.514042474615) / Math.Sqrt((0.615833105095612 / (32)) + (3.443926784241865 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -15.231052213763503 = (3.2970162235838605 - 53.514042474615) / 3.2970162235838605 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.813233384789 > 2.710236673905848. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.12726934630243 (T) = (0 -21.91271739605863) / Math.Sqrt((0.4328101070300295 / (31)) + (10.007120558707513 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.183879750091847 = (2.6775463551761867 - 21.91271739605863) / 2.6775463551761867 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.37184157007636 > 3.496404970751567. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.57345628411497 (T) = (0 -53.672164616818655) / Math.Sqrt((0.48916414680411413 / (33)) + (3.579476187006021 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.20989584093117 = (3.5287660861149446 - 53.672164616818655) / 3.5287660861149446 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).ExclusiveOrOperatorBenchmark.html>)	3.66 ns	48.64 ns	13.28	0.63	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanOrEqualAnyBenchmark.html>)	2.40 ns	67.92 ns	28.34	0.57	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanBenchmark.html>)	3.41 ns	84.24 ns	24.73	0.57	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).EqualsAllBenchmark.html>)	2.38 ns	31.23 ns	13.15	0.66	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).BitwiseAndBenchmark.html>)	3.24 ns	50.83 ns	15.69	0.58	True
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanOrEqualBenchmark.html>)	3.39 ns	83.74 ns	24.67	0.57	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).InequalityOperatorBenchmark.html>)	2.82 ns	19.15 ns	6.79	0.70	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).AbsBenchmark.html>)	8.92 ns	35.02 ns	3.92	0.59	True
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).EqualsStaticBenchmark.html>)	3.28 ns	83.30 ns	25.41	0.57	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).OnesComplementBenchmark.html>)	3.23 ns	44.47 ns	13.79	0.57	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).GreaterThanOrEqualAllBenchmark.html>)	2.40 ns	64.14 ns	26.75	0.59	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).AndNotBenchmark.html>)	5.80 ns	48.70 ns	8.39	0.63	True
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanAllBenchmark.html>)	2.54 ns	31.73 ns	12.49	0.73	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).BitwiseAndOperatorBenchmark.html>)	3.34 ns	47.64 ns	14.27	0.65	True
[SumBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).SumBenchmark.html>)	2.83 ns	59.98 ns	21.23	0.56	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).MaxBenchmark.html>)	3.23 ns	73.00 ns	22.58	0.52	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).CountBenchmark.html>)	0.00 ns	12.23 ns	8317.46	0.91	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).AllBitsSetBenchmark.html>)	2.08 ns	29.90 ns	14.36	0.62	True
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).XorBenchmark.html>)	3.62 ns	48.10 ns	13.29	0.60	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).MinBenchmark.html>)	3.23 ns	76.04 ns	23.57	0.52	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).BitwiseOrBenchmark.html>)	3.32 ns	49.21 ns	14.82	0.64	True
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).GreaterThanAnyBenchmark.html>)	2.40 ns	30.06 ns	12.52	0.66	False
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanAnyBenchmark.html>)	2.41 ns	78.88 ns	32.70	0.56	False
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).LessThanOrEqualAllBenchmark.html>)	2.46 ns	30.25 ns	12.28	0.71	False
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).GreaterThanAllBenchmark.html>)	2.48 ns	65.79 ns	26.54	0.60	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).ZeroBenchmark.html>)	2.73 ns	16.56 ns	6.06	0.62	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).OnesComplementOperatorBenchmark.html>)	6.64 ns	42.69 ns	6.43	0.58	True
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).GreaterThanBenchmark.html>)	3.21 ns	110.12 ns	34.31	0.53	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).ConditionalSelectBenchmark.html>)	3.54 ns	52.66 ns	14.89	0.58	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).GreaterThanOrEqualAnyBenchmark.html>)	2.44 ns	27.78 ns	11.37	0.70	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).EqualsAnyBenchmark.html>)	2.29 ns	64.35 ns	28.06	0.54	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).EqualityOperatorBenchmark.html>)	2.27 ns	21.39 ns	9.40	0.65	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt16).BitwiseOrOperatorBenchmark.html>)	3.20 ns	53.57 ns	16.76	0.60	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.63697631866046 > 3.435600805481036. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -74.87999628593823 (T) = (0 -49.08006109285047) / Math.Sqrt((0.33329549768998795 / (33)) + (1.4486061196921014 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.460949571012419 = (3.3939722182029812 - 49.08006109285047) / 3.3939722182029812 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 67.91953371602733 > 2.551066903540723. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.16589513217414 (T) = (0 -66.37168920791584) / Math.Sqrt((1.0767370206989795 / (33)) + (7.489954288712236 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.038715790961756 = (2.6507625136219675 - 66.37168920791584) / 2.6507625136219675 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 84.24261451226629 > 3.503970113893137. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.521230753905286 (T) = (0 -86.60913601613228) / Math.Sqrt((0.9015440029848998 / (33)) + (17.633844951772137 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -24.68241489508752 = (3.372312781719709 - 86.60913601613228) / 3.372312781719709 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.22909929520682 > 2.5778845396542933. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.591448385117364 (T) = (0 -29.40404133099448) / Math.Sqrt((0.6341096086259923 / (33)) + (10.336330309949727 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.162534773879582 = (2.634172428273206 - 29.40404133099448) / 2.634172428273206 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.833288226377995 > 3.8568194418631943. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.09524402932779 (T) = (0 -49.62659141299521) / Math.Sqrt((0.9417697573106111 / (33)) + (6.3549985795795445 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.328602456601281 = (3.7233154469556977 - 49.62659141299521) / 3.7233154469556977 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 83.73518270516341 > 3.535592126455318. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.19399586343264 (T) = (0 -85.92414850509999) / Math.Sqrt((0.8573099778404822 / (33)) + (36.88108270471128 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -25.572232327142164 = (3.23360670068103 - 85.92414850509999) / 3.23360670068103 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.147413494771964 > 2.5932016281584107. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.529875721171415 (T) = (0 -18.36719765577358) / Math.Sqrt((0.8793549309364683 / (33)) + (0.57546410580823 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.475564625319172 = (2.456964600849717 - 18.36719765577358) / 2.456964600849717 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.016688209006695 > 6.239178832691491. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.336814281109081 (T) = (0 -33.48278303136358) / Math.Sqrt((2.367484333762209 / (32)) + (14.522426439382434 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -4.686355001764505 = (5.888268147341083 - 33.48278303136358) / 5.888268147341083 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 83.298191865618 > 3.9116546668491234. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -82.26179615137714 (T) = (0 -84.01286195988801) / Math.Sqrt((3.914716652077062 / (31)) + (3.2790503631439716 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -19.9974116514902 = (4.001105629318153 - 84.01286195988801) / 4.001105629318153 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.47125530614612 > 3.3672866814152504. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -87.09262078542041 (T) = (0 -43.40010875661956) / Math.Sqrt((0.23048040436261055 / (33)) + (0.8219511951305778 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.333226009261944 = (3.255034357511949 - 43.40010875661956) / 3.255034357511949 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.13768939574173 > 2.6821748991389587. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -63.181557530503454 (T) = (0 -65.95536866997168) / Math.Sqrt((1.4732043853568748 / (32)) + (3.805416108366179 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -22.091479530807067 = (2.856264302249605 - 65.95536866997168) / 2.856264302249605 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.70182301567286 > 3.385019477932899. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -199.45171650569552 (T) = (0 -48.90702372869492) / Math.Sqrt((0.7643029616370063 / (33)) + (0.11329449075712905 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.395082164612583 = (3.651117860097831 - 48.90702372869492) / 3.651117860097831 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.726038032083714 > 3.154131823208148. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.951950362587695 (T) = (0 -32.339984955334536) / Math.Sqrt((1.491249345596204 / (33)) + (3.7151273452312488 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.631367649732086 = (2.7804112060785426 - 32.339984955334536) / 2.7804112060785426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.6410938308369 > 4.256560583093735. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.84415737033301 (T) = (0 -49.35296049621925) / Math.Sqrt((0.8680140740446616 / (33)) + (4.687449174505088 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.902129875528876 = (3.5500287321507793 - 49.35296049621925) / 3.5500287321507793 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SumBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 59.975705216346725 > 2.8795602964253293. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.72975797756309 (T) = (0 -54.335014922908684) / Math.Sqrt((0.4693247424920498 / (32)) + (15.028835998591328 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -21.43111476534663 = (2.422305600560242 - 54.335014922908684) / 2.422305600560242 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 73.00216409077706 > 3.4951165934277832. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.986532303868735 (T) = (0 -73.89318476292726) / Math.Sqrt((0.5883886496907057 / (33)) + (15.3453976113583 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -21.777052803398256 = (3.2441942950539526 - 73.89318476292726) / 3.2441942950539526 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.226026026222712 > 0.027093919932259944. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.686730517376366 (T) = (0 -13.564639629732282) / Math.Sqrt((0.10678357751982302 / (33)) + (2.1835927048790325 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -88.36091460553057 = (0.15179611454975822 - 13.564639629732282) / 0.15179611454975822 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.900641792600602 > 2.0837575705588804. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.347137888505685 (T) = (0 -29.872329581635924) / Math.Sqrt((0.7295229606113243 / (32)) + (1.080230978007054 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.325498041371095 = (2.0852559188774173 - 29.872329581635924) / 2.0852559188774173 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.09923318319219 > 3.689159412502504. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.38196445254751 (T) = (0 -49.460849191625314) / Math.Sqrt((0.29085282358371434 / (32)) + (4.698877576328772 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.773187385669905 = (3.3480147445772386 - 49.460849191625314) / 3.3480147445772386 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 76.04275600213154 > 3.404668960034857. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -64.68184211816605 (T) = (0 -72.96243574037712) / Math.Sqrt((1.9312620594369594 / (33)) + (4.363960362301166 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -19.191229918140074 = (3.6135706460767247 - 72.96243574037712) / 3.6135706460767247 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.2121531794723 > 3.678821345576588. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.74309726006432 (T) = (0 -48.66984010352045) / Math.Sqrt((0.8245384188628668 / (32)) + (5.365760685362205 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.448709609966095 = (3.3684558287440494 - 48.66984010352045) / 3.3684558287440494 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.05770025334011 > 2.459454976881187. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.903748141410322 (T) = (0 -28.370045861373335) / Math.Sqrt((0.25315960244106395 / (33)) + (8.368663759579679 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.69390483139961 = (2.4260541085639913 - 28.370045861373335) / 2.4260541085639913 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 78.87982584124691 > 2.543372952363287. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.86993107975004 (T) = (0 -70.32775469713697) / Math.Sqrt((0.9432329869575761 / (33)) + (35.043225267567315 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -26.8471753725951 = (2.5254897042932316 - 70.32775469713697) / 2.5254897042932316 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.24835793463621 > 2.593385789695045. IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.17696661448696 (T) = (0 -29.216687246570807) / Math.Sqrt((0.9038337343356998 / (32)) + (6.829537211768254 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.088388894406636 = (2.634890201344643 - 29.216687246570807) / 2.634890201344643 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.7937684962346 > 2.58985711911226. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -89.35439050340985 (T) = (0 -66.88742950629742) / Math.Sqrt((0.6525000749285949 / (33)) + (1.978759152366561 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -22.91346507124405 = (2.797061375548188 - 66.88742950629742) / 2.797061375548188 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.55702575221338 > 2.0437725767126067. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.793723363625961 (T) = (0 -15.67120941802644) / Math.Sqrt((0.19302270154505372 / (32)) + (2.95651023690415 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.69081288350914 = (2.037653191592932 - 15.67120941802644) / 2.037653191592932 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.68665983895793 > 6.0535105147719825. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.02835250907801 (T) = (0 -41.80653670131806) / Math.Sqrt((1.2975047838551137 / (33)) + (4.054726301417414 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.131886584846901 = (5.861918330297665 - 41.80653670131806) / 5.861918330297665 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 110.12091745456496 > 3.396391698319764. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -62.593188696126894 (T) = (0 -114.02657887561628) / Math.Sqrt((0.6652402182396383 / (32)) + (12.451157417052897 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -34.360966990169146 = (3.2246453810869284 - 114.02657887561628) / 3.2246453810869284 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.65570061116978 > 3.6133178315960084. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -59.21637729015387 (T) = (0 -53.4991763793133) / Math.Sqrt((0.19884923355443612 / (31)) + (2.841533269388528 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -14.902143661396563 = (3.364274497732394 - 53.4991763793133) / 3.364274497732394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.777637468069724 > 2.707859943046635. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.697453753190365 (T) = (0 -30.599149635100474) / Math.Sqrt((1.0025480536543667 / (32)) + (12.469703847266699 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.149519398599361 = (2.7444366471028734 - 30.599149635100474) / 2.7444366471028734 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.34835441503809 > 2.615359600603847. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.77634301429495 (T) = (0 -68.81863298791518) / Math.Sqrt((1.5117216620030103 / (32)) + (17.048451763113608 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -23.111586121994375 = (2.8541727881244374 - 68.81863298791518) / 2.8541727881244374 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.39008040815886 > 2.3877725868652293. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.437967362607385 (T) = (0 -20.149769113669848) / Math.Sqrt((0.4976433545958766 / (33)) + (1.7223968894187662 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.059943934250037 = (2.4999887440959907 - 20.149769113669848) / 2.4999887440959907 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.56606217097926 > 3.337690479913864. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.31876899707899 (T) = (0 -50.265723780537925) / Math.Sqrt((1.2214820846391212 / (32)) + (6.519186328066222 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.959614654303094 = (3.360094824774054 - 50.265723780537925) / 3.360094824774054 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20StringProperties).html>)	10.23 μs	13.33 μs	1.30	0.27	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20ObjectProperties).html>)	10.56 μs	16.29 μs	1.54	0.25	False
[PropertyIndexer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase%3a%20NumericProperties).html>)	10.53 μs	13.12 μs	1.25	0.26	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.33252985637088 > 10.809015787710486. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.253309994285525 (T) = (0 -14286.492861700703) / Math.Sqrt((224385.8469479101 / (33)) + (3104882.0925716776 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.35766951767606125 = (10522.80593745307 - 14286.492861700703) / 10522.80593745307 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: ObjectProperties) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.294288060061024 > 11.67706767027072. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.077411254678711 (T) = (0 -14682.48491938131) / Math.Sqrt((289542.66397240857 / (33)) + (1157645.8439369828 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3572563957924961 = (10817.768083390221 - 14682.48491938131) / 10817.768083390221 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.124674428512055 > 10.95821726638453. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -3.035500171291382 (T) = (0 -14372.935803708522) / Math.Sqrt((568844.9830873305 / (33)) + (5510534.881057909 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3323240129310821 = (10787.868164357704 - 14372.935803708522) / 10787.868164357704 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%200).html>)	11.54 ns	40.11 ns	3.48	0.62	True
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%204).html>)	13.12 ns	46.50 ns	3.54	0.58	True
[FormatterDateTimeOffsetNow - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value%3a%2012%2f30%2f2017%203%3a45%3a22%20AM%20-08%3a00).html>)	45.17 ns	52.22 ns	1.16	0.39	False
[FormatterDecimal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value%3a%20123456.789).html>)	56.49 ns	153.06 ns	2.71	0.36	True
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%200).html>)	11.72 ns	44.20 ns	3.77	0.61	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.11058414674342 > 12.127792169635406. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.24477132666774 (T) = (0 -37.26693298213216) / Math.Sqrt((3.8894017904228844 / (32)) + (6.217379922989969 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -2.0167353745617076 = (12.353398079387908 - 37.26693298213216) / 12.353398079387908 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 46.49795414834688 > 11.831169806074413. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.882232996298814 (T) = (0 -46.18128201500006) / Math.Sqrt((3.2809086560374854 / (32)) + (9.97781807543337 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -2.685881937329923 = (12.529235282140935 - 46.18128201500006) / 12.529235282140935 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.220207282643436 > 47.20216503476804. IsChangePoint: Marked as a change because one of 3/3/2023 1:35:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.44702676566931 (T) = (0 -51.4600670724167) / Math.Sqrt((3.9008687969521683 / (33)) + (0.8122266188919067 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -0.14496442478371452 = (44.94468645358792 - 51.4600670724167) / 44.94468645358792 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 153.06298759736822 > 61.39590656578834. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.95946172434656 (T) = (0 -159.10052825184263) / Math.Sqrt((4.559320064324594 / (32)) + (36.09573863911481 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -1.6824258717618388 = (59.3121807863209 - 159.10052825184263) / 59.3121807863209 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.203264073714 > 12.62648482126549. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.46706686765779 (T) = (0 -43.54531497015505) / Math.Sqrt((2.1348406297894247 / (32)) + (7.3275199240822 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -2.459254597997042 = (12.58806304553831 - 43.54531497015505) / 12.58806304553831 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).ExclusiveOrOperatorBenchmark.html>)	3.35 ns	48.16 ns	14.38	0.52	True
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).GreaterThanOrEqualAnyBenchmark.html>)	5.00 ns	26.46 ns	5.29	0.71	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).GreaterThanAnyBenchmark.html>)	2.44 ns	27.96 ns	11.46	0.67	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).ZeroBenchmark.html>)	2.14 ns	16.55 ns	7.74	0.64	True
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).EqualsAllBenchmark.html>)	2.51 ns	25.67 ns	10.24	0.68	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).CountBenchmark.html>)	0.00 ns	15.53 ns	5364.11	0.90	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).GreaterThanAllBenchmark.html>)	2.20 ns	116.69 ns	53.00	0.55	False
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).GreaterThanOrEqualAllBenchmark.html>)	2.55 ns	115.45 ns	45.26	0.49	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).XorBenchmark.html>)	3.24 ns	47.52 ns	14.69	0.63	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).EqualityOperatorBenchmark.html>)	2.22 ns	24.15 ns	10.89	0.69	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).BitwiseOrBenchmark.html>)	3.32 ns	48.52 ns	14.62	0.57	True
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).BitwiseOrOperatorBenchmark.html>)	6.13 ns	57.05 ns	9.31	0.62	True
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).LessThanOrEqualAnyBenchmark.html>)	2.60 ns	116.53 ns	44.79	0.48	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).LessThanAllBenchmark.html>)	2.18 ns	34.10 ns	15.65	0.74	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).BitwiseAndOperatorBenchmark.html>)	3.36 ns	51.81 ns	15.40	0.57	False
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).AbsBenchmark.html>)	2.94 ns	124.84 ns	42.41	0.48	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).BitwiseAndBenchmark.html>)	3.25 ns	48.82 ns	15.02	0.53	True
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).LessThanAnyBenchmark.html>)	2.85 ns	116.40 ns	40.78	0.54	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).OnesComplementOperatorBenchmark.html>)	5.69 ns	41.35 ns	7.27	0.63	True
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).LessThanOrEqualAllBenchmark.html>)	2.29 ns	33.70 ns	14.74	0.64	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).ConditionalSelectBenchmark.html>)	3.36 ns	53.39 ns	15.89	0.67	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).OnesComplementBenchmark.html>)	3.00 ns	44.53 ns	14.86	0.65	True
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).MaxBenchmark.html>)	3.56 ns	149.63 ns	42.05	0.45	False
[AllBitsSetBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).AllBitsSetBenchmark.html>)	1.94 ns	34.59 ns	17.85	0.64	True
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).MinBenchmark.html>)	2.72 ns	136.64 ns	50.31	0.46	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).InequalityOperatorBenchmark.html>)	2.02 ns	17.38 ns	8.61	0.72	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).EqualsAnyBenchmark.html>)	4.44 ns	118.83 ns	26.77	0.53	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).EqualsStaticBenchmark.html>)	3.12 ns	129.19 ns	41.38	0.43	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).LessThanBenchmark.html>)	3.66 ns	130.76 ns	35.77	0.44	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(SByte).AndNotBenchmark.html>)	3.25 ns	48.20 ns	14.85	0.53	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.15863072263914 > 3.533008457294948. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -493.37017397261366 (T) = (0 -48.131235788163806) / Math.Sqrt((0.032536653528824844 / (33)) + (0.02910962404734158 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.66351606734765 = (3.282380267263541 - 48.131235788163806) / 3.282380267263541 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.461563773387564 > 2.513907812436039. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.991603536655536 (T) = (0 -29.052609004735444) / Math.Sqrt((0.3068322656365184 / (33)) + (9.725370314960083 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.58678248078299 = (2.5073922853838004 - 29.052609004735444) / 2.5073922853838004 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.964337075302833 > 2.568366523748026. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.689797606198645 (T) = (0 -29.39746881431153) / Math.Sqrt((0.8902283959094986 / (32)) + (2.443599621623507 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -10.889266811869419 = (2.4726056938147893 - 29.39746881431153) / 2.4726056938147893 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.5471503755818 > 2.1935325783507524. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.09769102096535 (T) = (0 -17.524301926970878) / Math.Sqrt((0.09119463369174301 / (33)) + (4.7637975536208295 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.260086186008054 = (2.1215640530065762 - 17.524301926970878) / 2.1215640530065762 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.66971215352651 > 2.4967111106150583. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -30.39832266945324 (T) = (0 -26.70201552570829) / Math.Sqrt((0.4383015712448807 / (33)) + (2.513716216884029 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.358338368177016 = (2.350873398922513 - 26.70201552570829) / 2.350873398922513 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 15.532858241312338 > 0.0015202427790285513. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.98111143897888 (T) = (0 -14.909417007339709) / Math.Sqrt((0.11195931579608064 / (31)) + (0.4163343678404215 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -99.74559594851465 = (0.14799075698513972 - 14.909417007339709) / 0.14799075698513972 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 116.69205705462491 > 2.520277162625172. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -80.3806402482436 (T) = (0 -119.22701633246501) / Math.Sqrt((0.40781215156119394 / (31)) + (8.41276204763782 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -51.01992851641261 = (2.291948869073285 - 119.22701633246501) / 2.291948869073285 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 115.45060304109735 > 2.496685368821165. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -67.05111890365363 (T) = (0 -117.78708075044561) / Math.Sqrt((0.3652089513350762 / (33)) + (11.798680666878676 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -47.801180305581816 = (2.413611310482449 - 117.78708075044561) / 2.413611310482449 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 47.51624555642096 > 3.5720342464169565. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -45.13154298577016 (T) = (0 -49.036193134254276) / Math.Sqrt((1.3413900364171383 / (33)) + (3.846143011734988 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.718851196741689 = (3.8553948289619386 - 49.036193134254276) / 3.8553948289619386 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.150149330545286 > 2.407106504284505. IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.041733689112093 (T) = (0 -20.1469508560663) / Math.Sqrt((0.6812418302138061 / (33)) + (8.678064298626772 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.6610253284424 = (2.3261623297538065 - 20.1469508560663) / 2.3261623297538065 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.52359830699431 > 3.4690563090229087. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -247.93498147451479 (T) = (0 -48.21860070560583) / Math.Sqrt((0.6587873280698597 / (33)) + (0.049087417984776026 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -12.017937986616642 = (3.7040121680697777 - 48.21860070560583) / 3.7040121680697777 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.04718668006923 > 3.9219118322361872. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.78898783975209 (T) = (0 -51.13864110079189) / Math.Sqrt((1.8522129968133025 / (32)) + (17.32877395618672 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.085143602829406 = (3.3900002842001586 - 51.13864110079189) / 3.3900002842001586 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 116.52611122188894 > 2.5835060060530175. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -64.3251319541609 (T) = (0 -118.96153059690045) / Math.Sqrt((0.4711733622994809 / (32)) + (13.029418353818178 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -44.67505360205404 = (2.604518686137911 - 118.96153059690045) / 2.604518686137911 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.1018449972641 > 2.3242128478691213. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -15.524806559158353 (T) = (0 -32.489476764628556) / Math.Sqrt((0.6035934653314718 / (33)) + (14.824772644241678 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -11.85045816011311 = (2.528273806258016 - 32.489476764628556) / 2.528273806258016 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.81446038493329 > 3.436188623210243. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -79.09955532200837 (T) = (0 -50.827466277336036) / Math.Sqrt((2.819099020619974 / (32)) + (0.8036357478086933 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -12.987554340522614 = (3.6337636330095555 - 50.827466277336036) / 3.6337636330095555 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 124.83901932348356 > 3.3999535688492646. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.20812962114527 (T) = (0 -127.22541885058811) / Math.Sqrt((0.12557664674276411 / (33)) + (46.90333853620629 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.538238705394576 = (3.2177816467385925 - 127.22541885058811) / 3.2177816467385925 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.82095750817604 > 3.430392189088344. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -144.52445752368894 (T) = (0 -48.554101899086646) / Math.Sqrt((0.16971731981927624 / (32)) + (0.3705872881448328 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -13.614953791857769 = (3.3222206919420394 - 48.554101899086646) / 3.3222206919420394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 116.40354340552172 > 2.904581817378454. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.337507429551756 (T) = (0 -119.48698869094758) / Math.Sqrt((0.641705886755888 / (33)) + (39.091261364907275 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -44.11900413329791 = (2.6482629877631974 - 119.48698869094758) / 2.6482629877631974 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.35087646743898 > 6.42154501967965. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.14164710369476 (T) = (0 -42.45637898752778) / Math.Sqrt((1.4736044096553902 / (32)) + (3.290715349464478 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.106669686977347 = (5.974159607463843 - 42.45637898752778) / 5.974159607463843 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.69556573142772 > 2.6099270296804327. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.423343933512408 (T) = (0 -31.22207408913385) / Math.Sqrt((0.9642010057003089 / (32)) + (15.895814473048238 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.225990800898272 = (2.3606605024262786 - 31.22207408913385) / 2.3606605024262786 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.38763055478942 > 3.623109345653677. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -135.1707518263177 (T) = (0 -54.14927267173613) / Math.Sqrt((0.11313171121386349 / (33)) + (0.5437610535015422 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.6857215366374 = (3.6872054625744135 - 54.14927267173613) / 3.6872054625744135 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 44.53205489106789 > 3.204334287095223. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.625162704101015 (T) = (0 -42.45890190173637) / Math.Sqrt((0.7842359541514263 / (32)) + (2.733544030021705 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -12.14448518763998 = (3.2301684923850287 - 42.45890190173637) / 3.2301684923850287 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 149.63388260312163 > 3.565395291265565. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -32.125185134364536 (T) = (0 -137.7240012867406) / Math.Sqrt((0.9522056333852568 / (33)) + (69.83811035745873 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -39.754874608144355 = (3.3793258502436454 - 137.7240012867406) / 3.3793258502436454 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AllBitsSetBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 34.58512619800051 > 2.0843709887324486. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.070565942673316 (T) = (0 -32.917108914619604) / Math.Sqrt((0.18401679143610777 / (33)) + (4.456624704576264 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.272005651754426 = (2.1553887331647323 - 32.917108914619604) / 2.1553887331647323 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 136.6432720812101 > 3.7323616856899515. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -104.27123526756407 (T) = (0 -135.9194230033662) / Math.Sqrt((0.23659922052174506 / (33)) + (6.430051411989759 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -38.72162984192804 = (3.421798741498187 - 135.9194230033662) / 3.421798741498187 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 17.381958764402288 > 2.6008935433895983. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.981903549159085 (T) = (0 -18.90476384630203) / Math.Sqrt((1.4696615976833554 / (33)) + (3.439302155013904 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.861153817157421 = (2.755333046029025 - 18.90476384630203) / 2.755333046029025 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 118.83249835283048 > 2.55181590063505. IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -68.26067703685041 (T) = (0 -114.57841579743547) / Math.Sqrt((0.6674877480624145 / (32)) + (10.669666957561299 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -42.09940789968567 = (2.6584684426319254 - 114.57841579743547) / 2.6584684426319254 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 129.18652357963117 > 3.5123104460453454. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -119.26468249894309 (T) = (0 -127.96168921643334) / Math.Sqrt((1.3681496080000008 / (32)) + (4.1815726745012265 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -35.02991146975505 = (3.5515404839073645 - 127.96168921643334) / 3.5515404839073645 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.7639209686366 > 3.5816732785262033. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -138.89377103062546 (T) = (0 -128.3255149135862) / Math.Sqrt((0.6401565032679638 / (32)) + (3.1549131696973713 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -36.534033264386025 = (3.4189108857466484 - 128.3255149135862) / 3.4189108857466484 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 48.20233806364321 > 3.407162263031288. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -220.62890005367197 (T) = (0 -48.28845337656102) / Math.Sqrt((1.1174457793332686 / (33)) + (0.030002904855707602 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -13.130462437843429 = (3.417330012302891 - 48.28845337656102) / 3.417330012302891 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).SquareRootBenchmark.html>)	14.20 ns	22.52 ns	1.59	0.59	False
[GreaterThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAnyBenchmark.html>)	2.50 ns	23.46 ns	9.37	0.69	False
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAllBenchmark.html>)	2.46 ns	27.57 ns	11.20	0.72	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseOrOperatorBenchmark.html>)	3.28 ns	51.92 ns	15.85	0.55	True
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).DivideBenchmark.html>)	3.31 ns	32.18 ns	9.72	0.66	False
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAnyBenchmark.html>)	2.46 ns	23.61 ns	9.59	0.67	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).InequalityOperatorBenchmark.html>)	2.44 ns	18.30 ns	7.50	0.69	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).ConditionalSelectBenchmark.html>)	3.48 ns	175.52 ns	50.50	0.56	True
[LessThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanAnyBenchmark.html>)	2.46 ns	22.27 ns	9.05	0.64	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyBenchmark.html>)	3.21 ns	33.08 ns	10.31	0.65	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).ExclusiveOrOperatorBenchmark.html>)	3.36 ns	57.46 ns	17.08	0.56	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).SubtractBenchmark.html>)	3.20 ns	31.26 ns	9.76	0.65	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementBenchmark.html>)	3.20 ns	40.71 ns	12.72	0.66	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).EqualityOperatorBenchmark.html>)	1.97 ns	18.75 ns	9.54	0.68	False
[EqualsStaticBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).EqualsStaticBenchmark.html>)	3.15 ns	25.10 ns	7.97	0.66	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).AddOperatorBenchmark.html>)	2.12 ns	24.00 ns	11.30	0.60	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).AndNotBenchmark.html>)	3.32 ns	85.49 ns	25.77	0.60	True
[GreaterThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanAllBenchmark.html>)	2.45 ns	18.44 ns	7.51	0.66	False
[CountBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).CountBenchmark.html>)	0.00 ns	16.29 ns	∞	0.89	True
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).NegateBenchmark.html>)	3.18 ns	23.41 ns	7.37	0.58	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).OneBenchmark.html>)	1.85 ns	22.12 ns	11.98	0.72	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).SubtractionOperatorBenchmark.html>)	3.24 ns	24.76 ns	7.65	0.62	False
[LessThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualBenchmark.html>)	3.18 ns	35.19 ns	11.06	0.68	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAllBenchmark.html>)	2.28 ns	26.44 ns	11.61	0.69	False
[ZeroBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).ZeroBenchmark.html>)	1.32 ns	16.46 ns	12.42	0.70	False
[LessThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanBenchmark.html>)	3.15 ns	31.65 ns	10.06	0.65	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).XorBenchmark.html>)	3.21 ns	53.91 ns	16.77	0.57	True
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).DotBenchmark.html>)	2.21 ns	33.01 ns	14.96	0.82	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).AddBenchmark.html>)	3.44 ns	29.37 ns	8.53	0.60	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).MultiplyOperatorBenchmark.html>)	3.14 ns	22.76 ns	7.26	0.67	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseAndOperatorBenchmark.html>)	3.24 ns	55.55 ns	17.12	0.53	True
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAllBenchmark.html>)	3.04 ns	24.28 ns	7.98	0.63	False
[GreaterThanBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanBenchmark.html>)	3.92 ns	30.02 ns	7.65	0.62	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseOrBenchmark.html>)	3.80 ns	56.59 ns	14.90	0.64	True
[AbsBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).AbsBenchmark.html>)	4.04 ns	25.76 ns	6.38	0.60	False
[MinBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).MinBenchmark.html>)	3.36 ns	31.77 ns	9.46	0.65	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseAndBenchmark.html>)	2.62 ns	52.04 ns	19.83	0.63	True
[GreaterThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualAllBenchmark.html>)	2.56 ns	18.47 ns	7.22	0.68	False
[GreaterThanOrEqualBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).GreaterThanOrEqualBenchmark.html>)	3.46 ns	30.48 ns	8.81	0.65	False
[LessThanOrEqualAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).LessThanOrEqualAnyBenchmark.html>)	1.62 ns	21.21 ns	13.13	0.63	False
[EqualsAnyBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).EqualsAnyBenchmark.html>)	2.26 ns	24.23 ns	10.72	0.64	False
[MaxBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).MaxBenchmark.html>)	5.54 ns	32.45 ns	5.86	0.64	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementOperatorBenchmark.html>)	4.19 ns	42.09 ns	10.06	0.64	True
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).DivisionOperatorBenchmark.html>)	3.43 ns	22.54 ns	6.57	0.61	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Double&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Double>.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.515765149700368 > 13.819570136101886. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.318288280404966 (T) = (0 -24.623450546690293) / Math.Sqrt((2.06850151454716 / (32)) + (3.475542904479184 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7989322389318078 = (13.687814367767132 - 24.623450546690293) / 13.687814367767132 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.455009629871743 > 2.62427116757633. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.245846939402163 (T) = (0 -24.757580567197717) / Math.Sqrt((0.7940150353616356 / (33)) + (2.9424305227767316 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.991119955832103 = (2.753559143779266 - 24.757580567197717) / 2.753559143779266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 27.574938351144763 > 2.5478060915709864. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.777525062604692 (T) = (0 -26.10866789466349) / Math.Sqrt((0.8159137336849448 / (32)) + (3.0004844760001874 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -9.336319126557107 = (2.5259154225978264 - 26.10866789466349) / 2.5259154225978264 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 51.92428651088948 > 3.442157499381689. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -83.88376261477654 (T) = (0 -52.793431956517395) / Math.Sqrt((1.036424887334938 / (32)) + (1.258009213054035 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.582192182044192 = (3.3880619196413697 - 52.793431956517395) / 3.3880619196413697 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.18092235020315 > 3.650442305973816. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.864062010413946 (T) = (0 -30.496889980915146) / Math.Sqrt((0.3647024843775828 / (32)) + (1.277065637195121 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.594326260207161 = (3.548491069290641 - 30.496889980915146) / 3.548491069290641 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.612298305631537 > 2.6294522492609995. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.454214198196656 (T) = (0 -24.760688322964317) / Math.Sqrt((0.6361941426733502 / (33)) + (3.1668439498080025 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.041845004658244 = (2.738455294268805 - 24.760688322964317) / 2.738455294268805 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.304697671702947 > 2.529768837001669. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.27811953781028 (T) = (0 -17.50943821552258) / Math.Sqrt((0.7505606566530394 / (31)) + (0.29595432418969514 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -5.499577661724143 = (2.693934764197871 - 17.50943821552258) / 2.693934764197871 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 175.51647120006567 > 3.641118720158306. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -366.0170920984967 (T) = (0 -176.58326780057948) / Math.Sqrt((0.9582057165220519 / (33)) + (0.7772086851687069 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -47.938660567049205 = (3.6082570661828535 - 176.58326780057948) / 3.6082570661828535 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.271614117773122 > 2.5561637303961793. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.321829125649773 (T) = (0 -21.526373756497506) / Math.Sqrt((0.4073206328352673 / (33)) + (8.178597308677121 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.89550800576498 = (2.4199150562898426 - 21.526373756497506) / 2.4199150562898426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.083176181522134 > 3.517160480853137. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.338055962762354 (T) = (0 -32.55524668126583) / Math.Sqrt((0.7191964407501107 / (31)) + (8.067526647500406 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -8.285284593999673 = (3.506111886145487 - 32.55524668126583) / 3.506111886145487 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 57.45752206493812 > 3.3678252374414845. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.33394706096026 (T) = (0 -54.91452206004598) / Math.Sqrt((1.4169342716869602 / (32)) + (8.301061329005048 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.811633616576216 = (3.473045441836954 - 54.91452206004598) / 3.473045441836954 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.256749888307855 > 3.5433924536560295. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.57941084515167 (T) = (0 -33.55999012098557) / Math.Sqrt((0.512056345635695 / (33)) + (4.347235678118398 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -8.442932018653046 = (3.55397985018774 - 33.55999012098557) / 3.55397985018774 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 40.71263139600474 > 3.3330993301333867. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.29199457488291 (T) = (0 -41.130546957775266) / Math.Sqrt((0.7687028550646924 / (32)) + (3.5878975624276443 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -11.017383497612395 = (3.4225875346282373 - 41.130546957775266) / 3.4225875346282373 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.754204855923344 > 2.200795637845599. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.318609418020948 (T) = (0 -19.353975511690923) / Math.Sqrt((0.5290477891867222 / (31)) + (9.04646974276269 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.532802818981076 = (2.268185017546442 - 19.353975511690923) / 2.268185017546442 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsStaticBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.10260115256774 > 3.632524685115671. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -26.86547311440205 (T) = (0 -26.216094386714886) / Math.Sqrt((0.7340207513883188 / (32)) + (2.7815562708684216 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.606626372096537 = (3.4464811473958608 - 26.216094386714886) / 3.4464811473958608 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.001096365491424 > 3.349892788498595. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.153396700125676 (T) = (0 -23.72422412226004) / Math.Sqrt((0.7642378787028653 / (33)) + (2.527915690691444 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.050455971893472 = (3.364920540860942 - 23.72422412226004) / 3.364920540860942 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.48959930672633 > 3.479210953704662. IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -69.68780453541629 (T) = (0 -87.39931505184201) / Math.Sqrt((0.6721311427345098 / (32)) + (5.712843096109513 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -23.922755412359972 = (3.5068078792161943 - 87.39931505184201) / 3.5068078792161943 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.436462283658365 > 2.6755564734692467. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.206616226125437 (T) = (0 -20.551967395190445) / Math.Sqrt((0.6637130400507648 / (33)) + (4.227733679587075 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.626529745758832 = (2.6947993491560878 - 20.551967395190445) / 2.6947993491560878 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.CountBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.288240213376348 > 0.10250792003672085. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.93991566260431 (T) = (0 -14.998032178580564) / Math.Sqrt((0.2764186621073755 / (32)) + (1.0845626330342757 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -67.34030008849582 = (0.21946102313216626 - 14.998032178580564) / 0.21946102313216626 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.408517119067856 > 3.395478686170537. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.65413378029849 (T) = (0 -21.958083763640822) / Math.Sqrt((0.11595159794765442 / (33)) + (1.814661211223087 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.736150235158882 = (3.2597378320085686 - 21.958083763640822) / 3.2597378320085686 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.116288556134577 > 2.375038843509809. IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.996225428112474 (T) = (0 -24.133325286908157) / Math.Sqrt((0.4636382162751851 / (33)) + (5.313354628913061 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.362114993523026 = (2.1240169898531533 - 24.133325286908157) / 2.1240169898531533 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.76104317634545 > 3.5018310680697313. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.960863651676432 (T) = (0 -24.078817872021517) / Math.Sqrt((1.7086924401434775 / (32)) + (8.552685914339417 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.058688814734669 = (3.4112309671107983 - 24.078817872021517) / 3.4112309671107983 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.18875560725239 > 3.3936780158973106. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -40.98798955341804 (T) = (0 -35.902800363577434) / Math.Sqrt((0.8080360646353898 / (33)) + (2.4341064135353254 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.90640318382035 = (3.2919010748510784 - 35.902800363577434) / 3.2919010748510784 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.43933540926645 > 2.4041862461979195. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -63.07517605642013 (T) = (0 -27.457874164809056) / Math.Sqrt((0.6943261578759242 / (33)) + (0.5506024934075628 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -10.778239725863767 = (2.331237502707172 - 27.457874164809056) / 2.331237502707172 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.ZeroBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 16.457650705885957 > 2.170160550098032. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.10589879442861 (T) = (0 -16.319648525526468) / Math.Sqrt((0.2581775477967408 / (33)) + (0.3526065300506355 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.015135085050392 = (2.036103989808659 - 16.319648525526468) / 2.036103989808659 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.64810430316913 > 3.3393587231679005. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.972832995365394 (T) = (0 -32.42367955557805) / Math.Sqrt((1.028168548141369 / (32)) + (11.426419770840745 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.06657318599219 = (3.576177999166484 - 32.42367955557805) / 3.576177999166484 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.90637970918923 > 3.393370977184251. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -101.67235875618788 (T) = (0 -52.56445165043605) / Math.Sqrt((1.020543259356963 / (33)) + (0.8120172493744985 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.50895433575853 = (3.3892969514546687 - 52.56445165043605) / 3.3892969514546687 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 33.00857915743014 > 2.372152461115236. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -29.17107132177661 (T) = (0 -33.154755464941324) / Math.Sqrt((2.5504097091756925 / (33)) + (3.9485999442128814 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.840081830577418 = (3.0585336885021714 - 33.154755464941324) / 3.0585336885021714 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.37316228816686 > 3.5283264419584084. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.847324949302562 (T) = (0 -39.729641576456366) / Math.Sqrt((0.6618687603633694 / (32)) + (83.83923499890629 / (3))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (3) - 2, .025) and -10.292284362649115 = (3.518299778906381 - 39.729641576456366) / 3.518299778906381 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.759487074802717 > 3.6239534808189617. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.50585613942102 (T) = (0 -25.518091738653442) / Math.Sqrt((1.29254532832974 / (33)) + (3.6374811601558945 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.090370791784105 = (3.5989784579703885 - 25.518091738653442) / 3.5989784579703885 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.55341302971579 > 3.4845223521645146. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -48.39981275665259 (T) = (0 -55.29675632976491) / Math.Sqrt((0.5099041986133478 / (33)) + (4.50145051312036 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.354046611818102 = (3.6014451256910123 - 55.29675632976491) / 3.6014451256910123 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.280281517916023 > 2.9783777111216803. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.610442095446075 (T) = (0 -23.864652581118058) / Math.Sqrt((0.5135616748288625 / (32)) + (1.2111971642535984 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -8.083332985920302 = (2.627301302078176 - 23.864652581118058) / 2.627301302078176 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.020196877439187 > 3.4718984889819335. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.986007268454415 (T) = (0 -29.119955684048286) / Math.Sqrt((0.513302006337708 / (33)) + (9.115450109639271 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -7.5882247772302165 = (3.3906839235569874 - 29.119955684048286) / 3.3906839235569874 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 56.59387139978641 > 3.7396577007542238. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -51.1701956306648 (T) = (0 -54.2338320788005) / Math.Sqrt((0.5312700564579352 / (33)) + (3.8760338807865877 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -14.737786717150886 = (3.4460901684286394 - 54.2338320788005) / 3.4460901684286394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.AbsBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.762492385708942 > 3.5524119825607867. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -56.272555382961094 (T) = (0 -25.28221396278031) / Math.Sqrt((0.5270992331114633 / (33)) + (0.5479300289760874 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.721398037783934 = (3.2743052280253107 - 25.28221396278031) / 3.2743052280253107 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.MinBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.765715457102367 > 3.5884975932761742. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.263723911752184 (T) = (0 -27.97126252173691) / Math.Sqrt((0.18215801141202473 / (32)) + (8.012158220963814 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.9839625851476335 = (3.5034310623863836 - 27.97126252173691) / 3.5034310623863836 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 52.04438088137773 > 3.480434267829209. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -282.7408815499633 (T) = (0 -52.20636251777576) / Math.Sqrt((0.7280007902837629 / (32)) + (0.027948109861190288 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -14.13536589440134 = (3.449296362044818 - 52.20636251777576) / 3.449296362044818 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.473516733275556 > 2.745906225909647. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.170149652731649 (T) = (0 -20.127366877555154) / Math.Sqrt((1.2736358064697704 / (33)) + (6.812249282196151 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -6.328437267803309 = (2.746474608711266 - 20.127366877555154) / 2.746474608711266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.4830667554733 > 3.622714175387315. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.503740147654113 (T) = (0 -27.725022054213625) / Math.Sqrt((1.0018291052980028 / (32)) + (3.421114987329659 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -6.470969134615224 = (3.7110342118474753 - 27.725022054213625) / 3.7110342118474753 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.208377134954784 > 2.0988609354971124. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.263809097437555 (T) = (0 -20.035965812899374) / Math.Sqrt((0.626270172149036 / (31)) + (2.9628722464695016 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -7.4909179294735075 = (2.359693731504685 - 20.035965812899374) / 2.359693731504685 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAnyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.232255967994416 > 2.7508359437134353. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.816511082802805 (T) = (0 -25.113852605042037) / Math.Sqrt((0.5900469404651257 / (33)) + (5.148700159076249 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -9.14428315000083 = (2.4756655777140826 - 25.113852605042037) / 2.4756655777140826 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.MaxBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.45267314621955 > 3.5929633375435714. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.979354210279325 (T) = (0 -27.044449474775657) / Math.Sqrt((0.7236273851851257 / (31)) + (13.001888662518176 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -6.596728566144856 = (3.560012607966592 - 27.044449474775657) / 3.560012607966592 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 42.08996120426837 > 4.895743654167101. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.268729105317085 (T) = (0 -43.192958093342746) / Math.Sqrt((1.6506539041384944 / (32)) + (28.491438552586615 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -7.68382873827189 = (4.973953240576954 - 43.192958093342746) / 4.973953240576954 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorOf<Double>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.53841564646078 > 3.637175770775056. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.064510584148616 (T) = (0 -23.97165651838325) / Math.Sqrt((0.8358915130562947 / (31)) + (8.278594771323892 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -5.646446859808507 = (3.6066874563221747 - 23.97165651838325) / 3.6066874563221747 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Exceptions.Handling

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind%3a%20Software).html>)	36.10 μs	43.43 μs	1.20	0.03	False
[TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind%3a%20Hardware).html>)	41.06 μs	49.35 μs	1.20	0.05	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Exceptions.Handling*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Software) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 43.43387261566559 > 38.33566192853984. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.48691404919579 (T) = (0 -42957.74355732645) / Math.Sqrt((276399.87515278626 / (33)) + (314765.4537023848 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1826758864785514 = (36322.498876031255 - 42957.74355732645) / 36322.498876031255 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.3535936795854 > 42.51218021804992. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.272577963580002 (T) = (0 -47881.30147513795) / Math.Sqrt((360370.94233085087 / (33)) + (1106760.4838035442 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.17461767567188488 = (40763.307471726665 - 47881.30147513795) / 40763.307471726665 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_CancellationToken

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[CreateManyRegisterDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose.html>)	79.77 ns	97.82 ns	1.23	0.34	False
[CreateManyRegisterMultipleDispose - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose.html>)	410.65 ns	495.95 ns	1.21	0.28	False
[CreateLinkedTokenSource3 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3.html>)	332.51 ns	357.72 ns	1.08	0.24	False
[CreateLinkedTokenSource2 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2.html>)	229.26 ns	247.33 ns	1.08	0.28	False
[RegisterAndUnregister_Serial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial.html>)	97.48 ns	119.11 ns	1.22	0.39	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 97.8240193076923 > 85.4097296875. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.114374947457602 (T) = (0 -94.65481480961539) / Math.Sqrt((12.323456305772895 / (33)) + (4.9025476348278305 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1562343897320211 = (81.86472885619101 - 94.65481480961539) / 81.86472885619101 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 495.94960006666673 > 426.8465687437501. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.969852848106893 (T) = (0 -478.67232873392857) / Math.Sqrt((170.01198653546754 / (33)) + (136.7409564355315 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.16786330017425544 = (409.8701694474914 - 478.67232873392857) / 409.8701694474914 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3 ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 357.7235887824145 > 329.2610348278922. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.0687051849498035 (T) = (0 -362.8165427168679) / Math.Sqrt((96.68969419254033 / (31)) + (189.3860203329947 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.16063743929218807 = (312.60110214791166 - 362.8165427168679) / 312.60110214791166 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2 ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 247.33495344373068 > 244.01127057849587. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.03085926252188 (T) = (0 -255.47554783240463) / Math.Sqrt((53.198094288718586 / (32)) + (71.75286259890456 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.1387462775991023 = (224.34808601178608 - 255.47554783240463) / 224.34808601178608 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 119.10506957427746 > 103.32351751600191. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.624188960831841 (T) = (0 -114.74329962089304) / Math.Sqrt((19.97972025182085 / (32)) + (26.2436479568333 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.1512614771611277 = (99.66745339541475 - 114.74329962089304) / 99.66745339541475 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_UInt64.ToString(value%3a%2018446744073709551615).html>)	75.39 ns	171.75 ns	2.28	0.37	False
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_UInt64.TryFormat(value%3a%2018446744073709551615).html>)	40.56 ns	124.29 ns	3.06	0.44	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.ToString(value: 18446744073709551615) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 171.75255359203132 > 79.38318089085035. IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.063869902890424 (T) = (0 -174.20132245552082) / Math.Sqrt((9.002798898883398 / (33)) + (18.577569233272676 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.2774182457408407 = (76.49070291823072 - 174.20132245552082) / 76.49070291823072 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 124.28618389993491 > 43.072460051973856. IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.529340873868755 (T) = (0 -132.77185870728843) / Math.Sqrt((3.541188230148207 / (32)) + (49.813182934143924 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -2.140196166182772 = (42.28138997720201 - 132.77185870728843) / 42.28138997720201 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[Narrow_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_uint.html>)	6.38 μs	29.18 μs	4.57	0.36	False
[Widen_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_float.html>)	10.19 μs	21.36 μs	2.10	0.49	False
[Convert_float_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint.html>)	34.45 μs	53.81 μs	1.56	0.28	False
[Widen_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_ushort.html>)	12.39 μs	21.45 μs	1.73	0.32	False
[Widen_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_uint.html>)	9.63 μs	22.12 μs	2.30	0.43	False
[Widen_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_int.html>)	10.72 μs	23.17 μs	2.16	0.48	False
[Convert_double_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong.html>)	24.91 μs	35.78 μs	1.44	0.30	False
[Narrow_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_int.html>)	6.61 μs	28.57 μs	4.32	0.36	False
[Widen_sbyte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte.html>)	9.72 μs	21.79 μs	2.24	0.52	False
[Narrow_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_short.html>)	6.80 μs	29.19 μs	4.29	0.39	False
[Convert_int_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_int_float.html>)	17.65 μs	28.49 μs	1.61	0.45	False
[Convert_double_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_double_long.html>)	16.15 μs	30.10 μs	1.86	0.47	False
[Narrow_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_double.html>)	11.14 μs	31.12 μs	2.79	0.23	False
[Convert_ulong_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double.html>)	8.87 μs	23.77 μs	2.68	0.39	False
[Convert_uint_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float.html>)	15.68 μs	26.89 μs	1.71	0.42	False
[Convert_float_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_float_int.html>)	19.14 μs	28.97 μs	1.51	0.47	False
[Narrow_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong.html>)	6.15 μs	28.60 μs	4.65	0.38	False
[Narrow_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort.html>)	6.61 μs	32.47 μs	4.91	0.43	False
[Narrow_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_long.html>)	7.64 μs	28.69 μs	3.75	0.39	False
[Widen_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_short.html>)	9.69 μs	22.10 μs	2.28	0.33	False
[Widen_byte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_byte.html>)	12.09 μs	21.90 μs	1.81	0.45	False
[Convert_long_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_long_double.html>)	8.73 μs	23.27 μs	2.66	0.42	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorConvert.Narrow_uint ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.177291005535057 > 6.98739950434203. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -89.61636943097596 (T) = (0 -29081.749674187085) / Math.Sqrt((443067.37967987446 / (32)) + (192565.31579655103 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -3.2958317430233373 = (6769.759947283182 - 29081.749674187085) / 6769.759947283182 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.3621900037092 > 10.395271445988506. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.285551617228062 (T) = (0 -21691.30207147957) / Math.Sqrt((2226801.391774235 / (33)) + (471255.969504151 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.1808943306609607 = (9946.05825991836 - 21691.30207147957) / 9946.05825991836 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.8101755387931 > 36.96894430713346. IsChangePoint: Marked as a change because one of 1/31/2023 8:52:14 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.554257486194023 (T) = (0 -49523.75478345708) / Math.Sqrt((2216065.0907167085 / (33)) + (8296552.607943653 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3933529718368758 = (35542.863713972816 - 49523.75478345708) / 35542.863713972816 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_ushort ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.450591554752062 > 10.351075176783771. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.31174275087954 (T) = (0 -21539.030211656915) / Math.Sqrt((2320287.387769582 / (32)) + (79687.73638053691 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -1.1126337453864024 = (10195.34515090187 - 21539.030211656915) / 10195.34515090187 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_uint ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.12400428520626 > 10.13570147190903. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -20.804926639781996 (T) = (0 -22149.08597355265) / Math.Sqrt((1617746.5424328255 / (33)) + (1204613.8666203448 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.251465751794763 = (9837.629533514528 - 22149.08597355265) / 9837.629533514528 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.169974551369503 > 10.636735630282143. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.510064411565185 (T) = (0 -22000.670719555506) / Math.Sqrt((1982180.6420998713 / (31)) + (635752.5533105222 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -1.2094924952299886 = (9957.341229740376 - 22000.670719555506) / 9957.341229740376 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 35.77621764649925 > 25.14293833887383. IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.7216991616273 (T) = (0 -36802.18360729157) / Math.Sqrt((1346903.7618058447 / (32)) + (645194.0013610465 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.5144894985537062 = (24300.058628624756 - 36802.18360729157) / 24300.058628624756 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.573804166666665 > 6.7553931576076724. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.121050707942109 (T) = (0 -30737.207876637298) / Math.Sqrt((79035.88055677134 / (33)) + (13582744.589690698 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -3.6926935696303684 = (6550.0138503734415 - 30737.207876637298) / 6550.0138503734415 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.787625765839806 > 10.508132708488917. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -55.292009007938354 (T) = (0 -21769.02726223403) / Math.Sqrt((1442837.9948458234 / (32)) + (507.2934490646662 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -1.1743439306514112 = (10011.768127093055 - 21769.02726223403) / 10011.768127093055 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_short ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 29.186631137387383 > 7.0397755784114. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -66.89538744248848 (T) = (0 -29382.47551421832) / Math.Sqrt((278119.7442033487 / (32)) + (423335.0196863089 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -3.356803111174761 = (6744.044833895576 - 29382.47551421832) / 6744.044833895576 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_int_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.491158272616875 > 17.763636016786325. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.922010692838406 (T) = (0 -28179.84426909829) / Math.Sqrt((2367950.40746116 / (33)) + (1741499.960682273 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.9163590906187059 = (14704.88720357743 - 28179.84426909829) / 14704.88720357743 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_double_long ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 30.099413029100525 > 16.73821784522324. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.823450900272253 (T) = (0 -29005.898604608694) / Math.Sqrt((2599504.0324254837 / (33)) + (926363.7108052119 / (3))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (3) - 2, .025) and -0.8810758774229531 = (15419.845075227033 - 29005.898604608694) / 15419.845075227033 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_double ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 31.12023562416999 > 11.670642211440791. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.150980908225787 (T) = (0 -31856.718412570044) / Math.Sqrt((1036018.1961005086 / (33)) + (4680002.346231119 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.9318663733235244 = (10865.67883940007 - 31856.718412570044) / 10865.67883940007 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.7707719848608 > 9.252527725494582. IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.504646875302782 (T) = (0 -23492.570593314456) / Math.Sqrt((765750.805304226 / (33)) + (2386758.1920282566 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.632739587445579 = (8923.241290304815 - 23492.570593314456) / 8923.241290304815 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 26.885765933825372 > 16.10087199258899. IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.92564139677626 (T) = (0 -29516.703845377357) / Math.Sqrt((2495103.1447254485 / (33)) + (21541360.897633683 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.8837324553959154 = (15669.265431419057 - 29516.703845377357) / 15669.265431419057 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_float_int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.968281505179764 > 20.365590267212575. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.40548233404742 (T) = (0 -29716.360774780107) / Math.Sqrt((1726677.558339296 / (33)) + (3233949.997101856 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.5530361457254009 = (19134.365195924027 - 29716.360774780107) / 19134.365195924027 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.60401177973977 > 6.430910848429638. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.519992585034025 (T) = (0 -29268.816149487295) / Math.Sqrt((312043.5239613043 / (33)) + (669965.6518614566 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -3.6202302506549824 = (6334.925872003463 - 29268.816149487295) / 6334.925872003463 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 32.46943077299413 > 6.8490283896001625. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.89488909573308 (T) = (0 -29679.70357178543) / Math.Sqrt((63786.77416864508 / (33)) + (3706682.3062131493 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -3.4606887514086133 = (6653.6145482943775 - 29679.70357178543) / 6653.6145482943775 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Narrow_long ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.68827518607992 > 6.48904224324308. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -63.48513659693754 (T) = (0 -29278.948954881962) / Math.Sqrt((538716.8618320399 / (32)) + (443456.1104243559 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -3.4412218578097 = (6592.543649535583 - 29278.948954881962) / 6592.543649535583 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_short ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 22.097573799261077 > 10.828658837141429. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.711580951421016 (T) = (0 -22626.009670436073) / Math.Sqrt((1552910.2992871245 / (31)) + (1992261.863124293 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -1.2067426916648243 = (10253.12545767011 - 22626.009670436073) / 10253.12545767011 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Widen_byte ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.895619023263972 > 10.27470352022706. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.05933793463441 (T) = (0 -21751.12970757154) / Math.Sqrt((2198239.291703139 / (32)) + (50417.09061272021 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -1.1656122001408116 = (10043.87106156737 - 21751.12970757154) / 10043.87106156737 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Numerics.Tests.Perf_VectorConvert.Convert_long_double ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.26625911800487 > 9.166270352501396. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.71344385085659 (T) = (0 -22486.618724463762) / Math.Sqrt((941395.8888749556 / (33)) + (430801.8536432755 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -1.5163950839325582 = (8936.044609228153 - 22486.618724463762) / 8936.044609228153 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndRemove(String).Dictionary(Size%3a%20512).html>)	79.09 μs	88.88 μs	1.12	0.14	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndRemove<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 88.8848469132653 > 80.8009622663381. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.642401676112774 (T) = (0 -86599.80865293523) / Math.Sqrt((3474832.146100378 / (32)) + (3327335.7451366526 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.1210468653134404 = (77249.05294545581 - 86599.80865293523) / 77249.05294545581 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndRemove(Int32).Dictionary(Size%3a%20512).html>)	47.33 μs	53.50 μs	1.13	0.21	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 53.49756065905743 > 48.89165039198928. IsChangePoint: Marked as a change because one of 3/18/2023 7:37:20 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.813977261072527 (T) = (0 -54318.539987309654) / Math.Sqrt((2259569.012274402 / (33)) + (956370.693884144 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.17820144087487738 = (46102.93121605355 - 54318.539987309654) / 46102.93121605355 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTimeOffset

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22r%22).html>)	102.67 ns	167.28 ns	1.63	0.23	True
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22o%22).html>)	182.41 ns	222.20 ns	1.22	0.31	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTimeOffset.ToString(format: "r") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 167.28069128935914 > 110.47761853421297. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.787121434469373 (T) = (0 -172.0739725981516) / Math.Sqrt((17.220299161132445 / (32)) + (18.865103501113666 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.6220127952231327 = (106.08669247549321 - 172.0739725981516) / 106.08669247549321 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Tests.Perf_DateTimeOffset.ToString(format: "o") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 222.19662399244075 > 137.57012680376047. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/11/2023 10:53:42 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.689627461332151 (T) = (0 -224.33983452431568) / Math.Sqrt((699.5458126819344 / (32)) + (33.45687368632038 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.4513266553683589 = (154.57570058022282 - 224.33983452431568) / 154.57570058022282 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndClear(String).IDictionary(Size%3a%20512).html>)	48.37 μs	55.39 μs	1.15	0.16	False
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndClear(String).Dictionary(Size%3a%20512).html>)	45.87 μs	50.77 μs	1.11	0.13	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 55.3910600875379 > 49.654420618781764. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.268692160240306 (T) = (0 -57132.07431738307) / Math.Sqrt((1111797.1228252158 / (32)) + (2554943.5444869436 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.19312668548527306 = (47884.33199291498 - 57132.07431738307) / 47884.33199291498 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Collections.CreateAddAndClear<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.774394118158625 > 46.98168078442529. IsChangePoint: Marked as a change because one of 3/10/2023 4:14:40 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.988502272540774 (T) = (0 -50922.539083698706) / Math.Sqrt((1933060.032038856 / (32)) + (22858.977859601437 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.13783092322866083 = (44754.04741084296 - 50922.539083698706) / 44754.04741084296 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToWriter(Mode%3a%20SourceGen).html>)	686.19 ns	775.52 ns	1.13	0.19	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	890.93 ns	1.11 μs	1.24	0.17	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ClassRecord&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 775.5229816250855 > 701.4675863022985. IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.926492052397105 (T) = (0 -782.8627472886412) / Math.Sqrt((463.31423064054263 / (33)) + (643.913400530308 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.17764412094259338 = (664.7702250337167 - 782.8627472886412) / 664.7702250337167 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.1083515267309996 > 933.2488007155503. IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -3.98076004935242 (T) = (0 -1010.9835969893516) / Math.Sqrt((527.3361796311368 / (33)) + (4227.754198161444 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14807255861156118 = (880.5920753057627 - 1010.9835969893516) / 880.5920753057627 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SquareRootBenchmark.html>)	32.64 ns	49.86 ns	1.53	0.60	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 49.864796323587974 > 31.256735451577292. IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.714785163372712 (T) = (0 -51.904740271578014) / Math.Sqrt((3.3957080818605543 / (32)) + (17.910328699482278 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.7919910776230797 = (28.964843028362136 - 51.904740271578014) / 28.964843028362136 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndClear(Int32).Dictionary(Size%3a%20512).html>)	28.64 μs	37.35 μs	1.30	0.23	False
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CreateAddAndClear(Int32).IDictionary(Size%3a%20512).html>)	31.91 μs	39.03 μs	1.22	0.18	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.34841670218207 > 30.05025995936147. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.471772756114454 (T) = (0 -36830.221477181985) / Math.Sqrt((1475539.367542027 / (31)) + (203903.48688992814 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.263604844599568 = (29146.94545101507 - 36830.221477181985) / 29146.94545101507 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 39.029361859773644 > 33.75728050202142. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.55205423643084 (T) = (0 -38645.44764195724) / Math.Sqrt((1420748.4792314952 / (32)) + (299365.2941522389 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.18600600233031087 = (32584.529560579926 - 38645.44764195724) / 32584.529560579926 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_DateTime.ToString(format%3a%20%22o%22).html>)	179.26 ns	199.49 ns	1.11	0.25	False
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_DateTime.ToString(format%3a%20%22r%22).html>)	99.20 ns	156.75 ns	1.58	0.30	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTime.ToString(format: "o") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 199.48866325550102 > 138.75990518769797. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/11/2023 10:53:42 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.999178003736592 (T) = (0 -204.26051296121244) / Math.Sqrt((636.8797328485631 / (33)) + (51.77543258052676 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3849856230788397 = (147.48204570321738 - 204.26051296121244) / 147.48204570321738 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Tests.Perf_DateTime.ToString(format: "r") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 156.75226927746795 > 103.66739711005619. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -58.71307713882726 (T) = (0 -154.75558792386033) / Math.Sqrt((18.50562305403827 / (33)) + (1.9277757677342267 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.6324170253389207 = (94.80150324438704 - 154.75558792386033) / 94.80150324438704 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Load - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName%3a%20%22names.xml%22).html>)	358.50 μs	393.73 μs	1.10	0.14	False
[Load - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName%3a%20%22deep.xml%22).html>)	135.66 μs	149.27 μs	1.10	0.02	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks*'

### Payloads [Baseline]() [Compare]() ### Histogram #### Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "names.xml") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 393.72943064346 > 363.01536963328846. IsChangePoint: Marked as a change because one of 3/5/2023 4:40:20 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -13.64908513973331 (T) = (0 -389051.69609275373) / Math.Sqrt((26929465.42620764 / (33)) + (27559798.629316285 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.10789716010160957 = (351162.2830200885 - 389051.69609275373) / 351162.2830200885 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "deep.xml") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 149.26975721452942 > 143.94586619842985. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 9:47:42 AM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.04577108155681 (T) = (0 -149475.56044901928) / Math.Sqrt((2817509.069488063 / (29)) + (1794613.703730503 / (6))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (6) - 2, .025) and -0.08224709700573767 = (138115.92644838188 - 149475.56044901928) / 138115.92644838188 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CtorFromCollection(String).FrozenDictionary(Size%3a%20512).html>)	10.70 μs	13.49 μs	1.26	0.11	True
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.CtorFromCollection(String).Dictionary(Size%3a%20512).html>)	10.76 μs	12.90 μs	1.20	0.03	True

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<String>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 13.486868842364533 > 11.236608701610677. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.51651945275458 (T) = (0 -13820.18976425906) / Math.Sqrt((35159.47854793163 / (33)) + (317972.9489311208 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.2754781891804181 = (10835.300737787979 - 13820.18976425906) / 10835.300737787979 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` #### System.Collections.CtorFromCollection<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.897150781466113 > 11.206948979313745. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.427741482768152 (T) = (0 -13010.160572191406) / Math.Sqrt((29456.884227914925 / (31)) + (25264.897594077844 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.22889448910131893 = (10586.881695356642 - 13010.160572191406) / 10586.881695356642 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SquareRootBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SquareRootBenchmark.html>)	28.58 ns	50.02 ns	1.75	0.62	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SquareRootBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 50.02023714103036 > 34.335057321978475. IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.653546317143874 (T) = (0 -49.80098236434088) / Math.Sqrt((6.368890969145626 / (32)) + (6.208026446594513 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.6376281272142992 = (30.410434174121846 - 49.80098236434088) / 30.410434174121846 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Guids

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteGuids - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	6.21 ms	7.24 ms	1.17	0.01	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.2411159763888895 > 6.459883534495193. IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.50183499220337 (T) = (0 -7306010.440203373) / Math.Sqrt((1543835515.956608 / (32)) + (2503746519.9986897 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.1878687265222133 = (6150520.067645497 - 7306010.440203373) / 6150520.067645497 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	554.44 ns	606.86 ns	1.09	0.22	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToWriter(Mode%3a%20SourceGen).html>)	373.07 ns	465.28 ns	1.25	0.22	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;SimpleStructWithProperties&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 606.8604847424357 > 587.7472005108623. IsChangePoint: Marked as a change because one of 3/2/2023 11:02:42 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.856513045362943 (T) = (0 -620.2345604794052) / Math.Sqrt((295.8190333568483 / (33)) + (99.39605391027361 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.10181695316540673 = (562.9197832702929 - 620.2345604794052) / 562.9197832702929 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 465.2795162849873 > 402.2859293421235. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.28988594246633 (T) = (0 -448.71148977053133) / Math.Sqrt((132.09776945295556 / (33)) + (170.07656179723102 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1644322884758419 = (385.3478593915172 - 448.71148977053133) / 385.3478593915172 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.TryAddDefaultSize(Int32).Dictionary(Count%3a%20512).html>)	27.45 μs	37.35 μs	1.36	0.20	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 37.34689616284013 > 29.344958598858174. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.905785647699084 (T) = (0 -35780.52320451258) / Math.Sqrt((776001.6241390163 / (32)) + (1192257.5480073027 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.25750626384705083 = (28453.554652722214 - 35780.52320451258) / 28453.554652722214 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddGiventSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.TryAddGiventSize(Int32).Dictionary(Count%3a%20512).html>)	20.19 μs	23.49 μs	1.16	0.33	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddGiventSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 23.48739977443609 > 21.16111479639935. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.762315330887142 (T) = (0 -22871.389921543734) / Math.Sqrt((819746.7894097582 / (33)) + (1372857.458886978 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14458761642227894 = (19982.20983120061 - 22871.389921543734) / 19982.20983120061 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<StructRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToWriter(Mode%3a%20SourceGen).html>)	722.31 ns	819.16 ns	1.13	0.22	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;StructRecord&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 819.1598686901701 > 740.7722974455089. IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.944832554717001 (T) = (0 -831.5750459207572) / Math.Sqrt((790.0799242363175 / (32)) + (695.4076460067794 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.17863967480074272 = (705.537972036569 - 831.5750459207572) / 705.537972036569 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Linq.Tests.Perf_Enumerable.ToDictionary(input%3a%20IEnumerable).html>)	7.94 μs	10.52 μs	1.32	0.27	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_Enumerable.ToDictionary(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.52276296542553 > 8.54274984620946. IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.2678599838327544 (T) = (0 -9808.170661716711) / Math.Sqrt((112647.1446598333 / (33)) + (236136.186388079 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.19004295448895692 = (8241.862719929011 - 9808.170661716711) / 8241.862719929011 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Concurrent.Count<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.Concurrent.Count(String).Queue(Size%3a%20512).html>)	30.47 ns	45.91 ns	1.51	0.63	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Concurrent.Count<String>.Queue(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 45.90995755488205 > 35.24428408137748. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.705093382161923 (T) = (0 -46.6352176950316) / Math.Sqrt((8.586943971017694 / (33)) + (0.41587606425271423 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4160500780619338 = (32.9333110583621 - 46.6352176950316) / 32.9333110583621 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.AddGivenSize(Int32).IDictionary(Size%3a%20512).html>)	22.93 μs	24.49 μs	1.07	0.29	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 24.489117123109022 > 24.080578063537395. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.159952040466796 (T) = (0 -25113.914337973947) / Math.Sqrt((485640.5934535795 / (32)) + (342701.6355358313 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.09955276903715828 = (22840.117405156794 - 25113.914337973947) / 22840.117405156794 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Collections.TryAddDefaultSize(String).Dictionary(Count%3a%20512).html>)	43.55 μs	51.34 μs	1.18	0.18	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads