[Perf] Linux/x64: 151 Improvements on 5/29/2023 9:06:42 PM

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementOperatorBenchmark.html>)	22.83 ns	12.69 ns	0.56	0.44	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseAndBenchmark.html>)	23.40 ns	13.01 ns	0.56	0.41	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).ConditionalSelectBenchmark.html>)	50.96 ns	15.60 ns	0.31	0.30	True
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).AddBenchmark.html>)	68.22 ns	13.51 ns	0.20	0.29	True
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).XorBenchmark.html>)	23.77 ns	13.33 ns	0.56	0.46	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).SubtractionOperatorBenchmark.html>)	67.16 ns	12.91 ns	0.19	0.29	True
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).EqualityOperatorBenchmark.html>)	11.75 ns	7.23 ns	0.62	0.63	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).OnesComplementBenchmark.html>)	22.90 ns	12.32 ns	0.54	0.48	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyOperatorBenchmark.html>)	71.87 ns	27.93 ns	0.39	0.17	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).AndNotBenchmark.html>)	30.67 ns	14.92 ns	0.49	0.37	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).ExclusiveOrOperatorBenchmark.html>)	24.64 ns	12.33 ns	0.50	0.47	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).NegateBenchmark.html>)	64.94 ns	12.56 ns	0.19	0.20	True
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).MultiplyBenchmark.html>)	67.16 ns	28.04 ns	0.42	0.21	True
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Byte).BitwiseOrBenchmark.html>)	23.62 ns	13.49 ns	0.57	0.41	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.685627203907703 < 21.992445047611533. IsChangePoint: Marked as a change because one of 3/21/2023 3:33:39 AM, 3/21/2023 4:52:34 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 30.114554702335493 (T) = (0 -12.949046435444187) / Math.Sqrt((23.371138904810277 / (299)) + (1.0894345168674056 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4462406657133101 = (23.38388833142497 - 12.949046435444187) / 23.38388833142497 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.007019292845804 < 22.226059840135907. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.365469726886055 (T) = (0 -13.201358961874682) / Math.Sqrt((25.375163821388227 / (299)) + (0.4130746314215269 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.48626191561568954 = (25.69667183170945 - 13.201358961874682) / 25.69667183170945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.597769879559266 < 47.87584846508905. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 103.97957360605788 (T) = (0 -16.181971597880114) / Math.Sqrt((28.978063436380648 / (299)) + (0.6168116051496624 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6905784596145338 = (52.297495441723925 - 16.181971597880114) / 52.297495441723925 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.508819015583688 < 64.51658868578087. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 153.57149458803883 (T) = (0 -13.197358419219908) / Math.Sqrt((38.22021048496332 / (299)) + (0.5292938540227656 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.8174999056554304 = (72.31425532472667 - 13.197358419219908) / 72.31425532472667 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.331598305756092 < 22.358214245389693. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 35.60154497781507 (T) = (0 -13.277256072059592) / Math.Sqrt((33.07282040254772 / (299)) + (0.5091611005993522 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4917442160572609 = (26.123177525030247 - 13.277256072059592) / 26.123177525030247 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.90774261681884 < 64.092990823426. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 142.8203545750552 (T) = (0 -13.250741998905637) / Math.Sqrt((44.22287142999277 / (299)) + (0.6160604143529408 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.8170117235441067 = (72.41306522770348 - 13.250741998905637) / 72.41306522770348 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.227923792551085 < 10.983977876562838. IsChangePoint: Marked as a change because one of 5/9/2023 7:00:05 PM, 5/10/2023 2:00:36 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 25.600115689693826 (T) = (0 -7.495780834084472) / Math.Sqrt((16.22239832082121 / (299)) + (0.4671696789726034 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4798142979732796 = (14.409817118924648 - 7.495780834084472) / 14.409817118924648 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.323043304010287 < 20.721428646001375. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 29.99137855428486 (T) = (0 -12.532194268859595) / Math.Sqrt((32.268535054023424 / (299)) + (0.9613189018101939 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4767011951965959 = (23.948448102356664 - 12.532194268859595) / 23.948448102356664 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 27.929382653278427 < 65.1813121804587. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 94.1269529483991 (T) = (0 -28.739249155216328) / Math.Sqrt((35.754490762571066 / (299)) + (2.0719185601262704 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5938325608511221 = (70.75714689350605 - 28.739249155216328) / 70.75714689350605 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.920607633442293 < 29.379165201556756. IsChangePoint: Marked as a change because one of 3/21/2023 10:36:00 PM, 3/22/2023 7:51:01 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 51.71500542160807 (T) = (0 -13.988461657853618) / Math.Sqrt((35.38258087551974 / (299)) + (0.6666938260396955 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5838186677547559 = (33.611458693708556 - 13.988461657853618) / 33.611458693708556 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.33066905310538 < 22.114410998933803. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 29.027356738689072 (T) = (0 -13.2564022536474) / Math.Sqrt((25.39515735910084 / (299)) + (2.4621958797301904 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48394896010902405 = (25.688161109893368 - 13.2564022536474) / 25.688161109893368 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.560760620721165 < 61.6794014316375. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 129.07717927874359 (T) = (0 -12.549283734218866) / Math.Sqrt((47.12525048191752 / (299)) + (1.0747602083729357 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.8210367167093412 = (70.12211389661007 - 12.549283734218866) / 70.12211389661007 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 28.03912387844347 < 64.30897017080989. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 93.39321436442432 (T) = (0 -28.66515387908271) / Math.Sqrt((45.17278895088144 / (299)) + (1.4739375062049067 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5975996070526831 = (71.23540230447938 - 28.66515387908271) / 71.23540230447938 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.486959835348205 < 22.024955254994797. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.64342436237453 (T) = (0 -13.346208033782583) / Math.Sqrt((28.718021956087618 / (299)) + (0.3743921123294729 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4838342329335539 = (25.856437767335553 - 13.346208033782583) / 25.856437767335553 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).SubtractionOperatorBenchmark.html>)	67.14 ns	12.60 ns	0.19	0.27	True
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseAndOperatorBenchmark.html>)	22.72 ns	12.17 ns	0.54	0.41	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).SubtractBenchmark.html>)	67.88 ns	12.95 ns	0.19	0.28	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).ConditionalSelectBenchmark.html>)	49.63 ns	15.71 ns	0.32	0.37	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).AddBenchmark.html>)	67.47 ns	13.15 ns	0.19	0.24	True
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).XorBenchmark.html>)	23.84 ns	14.05 ns	0.59	0.40	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).AndNotBenchmark.html>)	33.72 ns	14.04 ns	0.42	0.36	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).UnaryNegateOperatorBenchmark.html>)	65.52 ns	12.90 ns	0.20	0.19	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).BitwiseAndBenchmark.html>)	24.47 ns	13.01 ns	0.53	0.41	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).EqualsAllBenchmark.html>)	11.36 ns	8.20 ns	0.72	0.63	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(SByte).AddOperatorBenchmark.html>)	68.53 ns	13.36 ns	0.19	0.26	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.599326422648216 < 63.95201465396842. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 156.0586854330647 (T) = (0 -13.470938080220492) / Math.Sqrt((32.66985781077093 / (299)) + (0.7799539726087117 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.8127970287206657 = (71.9589971684791 - 13.470938080220492) / 71.9589971684791 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.170159960362742 < 22.114357392719825. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 42.52866707879064 (T) = (0 -13.183752014930983) / Math.Sqrt((18.764314702017487 / (299)) + (0.5373826822112107 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48356167168100517 = (25.52822145839573 - 13.183752014930983) / 25.52822145839573 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.94616731556474 < 64.4172130744398. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 150.61673536770036 (T) = (0 -13.354692087939187) / Math.Sqrt((39.09058032446614 / (299)) + (0.5232228872097316 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.8145477309854934 = (72.01147852709497 - 13.354692087939187) / 72.01147852709497 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.705936291256302 < 47.288283022569715. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 87.46028279255756 (T) = (0 -16.364396014566587) / Math.Sqrt((44.52506835370886 / (299)) + (0.7159159496219787 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.691835326799765 = (53.10276432605094 - 16.364396014566587) / 53.10276432605094 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.149899532970348 < 64.12165821155203. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 135.38882114026617 (T) = (0 -13.50601852053589) / Math.Sqrt((47.053762614753495 / (299)) + (0.8377889264290184 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.8136005906819205 = (72.45741051404657 - 13.50601852053589) / 72.45741051404657 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.052543349381782 < 22.141912833449883. IsChangePoint: Marked as a change because one of 3/18/2023 12:49:26 AM, 3/18/2023 5:00:39 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.81590904859357 (T) = (0 -13.000843588046438) / Math.Sqrt((23.786066123215782 / (299)) + (0.4847450971142482 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.489715934381779 = (25.477659335287324 - 13.000843588046438) / 25.477659335287324 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.035147417610345 < 31.470522501952278. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 58.472596016629026 (T) = (0 -13.960055314656294) / Math.Sqrt((24.6887311430368 / (299)) + (0.5482580148671088 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5742049609102261 = (32.78585712153631 - 13.960055314656294) / 32.78585712153631 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.896948816754128 < 62.34623298630839. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 153.83162527340176 (T) = (0 -12.637150436975512) / Math.Sqrt((35.60511516076085 / (299)) + (0.47353553299649787 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.8189199165657202 = (69.78763316928757 - 12.637150436975512) / 69.78763316928757 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.011466876819904 < 22.560071205436426. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.294070446183056 (T) = (0 -13.352265452064383) / Math.Sqrt((36.694240557247234 / (299)) + (0.41953075813534546 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4890363360362364 = (26.1315361418954 - 13.352265452064383) / 26.1315361418954 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.195828464003021 < 10.93408119345021. IsChangePoint: Marked as a change because one of 5/29/2023 11:58:32 PM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 22.791241189064422 (T) = (0 -7.676140056919265) / Math.Sqrt((20.676823616311736 / (299)) + (0.4091152848661767 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.465732638646716 = (14.36760059135153 - 7.676140056919265) / 14.36760059135153 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<SByte>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.355983078712256 < 64.29519550150226. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 177.4901019832981 (T) = (0 -13.327795938118383) / Math.Sqrt((29.36762658835325 / (299)) + (0.3048741109716171 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.8153533282177399 = (72.17999549883491 - 13.327795938118383) / 72.17999549883491 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).SubtractionOperatorBenchmark.html>)	47.45 ns	12.91 ns	0.27	0.26	True
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualsAllBenchmark.html>)	12.98 ns	8.71 ns	0.67	0.63	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AddOperatorBenchmark.html>)	44.45 ns	12.91 ns	0.29	0.23	True
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).UnaryNegateOperatorBenchmark.html>)	43.91 ns	11.68 ns	0.27	0.25	True
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).MultiplyOperatorBenchmark.html>)	45.41 ns	12.96 ns	0.29	0.21	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).ConditionalSelectBenchmark.html>)	53.53 ns	15.86 ns	0.30	0.30	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).SubtractBenchmark.html>)	45.39 ns	13.41 ns	0.30	0.20	True
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseAndOperatorBenchmark.html>)	22.90 ns	12.99 ns	0.57	0.42	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AndNotBenchmark.html>)	32.98 ns	14.06 ns	0.43	0.41	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).XorBenchmark.html>)	23.35 ns	12.94 ns	0.55	0.38	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseOrBenchmark.html>)	24.13 ns	12.96 ns	0.54	0.42	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).OnesComplementOperatorBenchmark.html>)	23.27 ns	12.38 ns	0.53	0.43	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).EqualityOperatorBenchmark.html>)	13.86 ns	8.08 ns	0.58	0.63	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).AddBenchmark.html>)	45.41 ns	12.89 ns	0.28	0.19	True
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseOrOperatorBenchmark.html>)	24.85 ns	13.36 ns	0.54	0.38	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).ExclusiveOrOperatorBenchmark.html>)	25.35 ns	13.45 ns	0.53	0.39	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).NegateBenchmark.html>)	46.00 ns	12.22 ns	0.27	0.27	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).OnesComplementBenchmark.html>)	21.87 ns	13.05 ns	0.60	0.47	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int16).BitwiseAndBenchmark.html>)	22.93 ns	12.91 ns	0.56	0.37	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.911034598777997 < 43.0183097799096. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 65.31023366567409 (T) = (0 -13.783258364758044) / Math.Sqrt((23.689076609372663 / (299)) + (4.665364774531599 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.706735778649812 = (46.99945428494462 - 13.783258364758044) / 46.99945428494462 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.714401382561991 < 11.63744238776675. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 20.469604541802298 (T) = (0 -7.679860165755977) / Math.Sqrt((30.2134034294286 / (299)) + (0.6557195874696393 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4874138678081112 = (14.982574992647262 - 7.679860165755977) / 14.982574992647262 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.910559784641714 < 42.165221420633486. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 90.36465985782631 (T) = (0 -13.344694058159554) / Math.Sqrt((30.855187705261464 / (299)) + (0.9400458307619991 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.717585113390059 = (47.25209148266558 - 13.344694058159554) / 47.25209148266558 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.677965294539643 < 41.57439275942992. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 107.39884964570122 (T) = (0 -12.512982923231657) / Math.Sqrt((26.151072524711992 / (299)) + (0.27951285925247193 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7289833628726214 = (46.170534236798616 - 12.512982923231657) / 46.170534236798616 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.957916012539984 < 42.04363748538669. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.55310618042901 (T) = (0 -14.110056613360587) / Math.Sqrt((23.400981969784482 / (299)) + (15.597583293636646 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6977441609070216 = (46.682494722691295 - 14.110056613360587) / 46.682494722691295 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.861614160380814 < 50.43878361906. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 97.17250049771403 (T) = (0 -16.14828094285543) / Math.Sqrt((31.65324626486664 / (299)) + (0.8833045129951103 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6923300267867423 = (52.485722848431635 - 16.14828094285543) / 52.485722848431635 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.412207116574896 < 42.67883724911653. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 96.08117058641132 (T) = (0 -13.049940448282545) / Math.Sqrt((26.550888215721262 / (299)) + (0.9855033416574926 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7238129731944218 = (47.25037449883211 - 13.049940448282545) / 47.25037449883211 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.993153756456921 < 21.92152004053187. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 35.246166383147404 (T) = (0 -13.080507838833022) / Math.Sqrt((33.2910159134628 / (299)) + (0.61209405778563 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.49825986448366144 = (26.070284023365858 - 13.080507838833022) / 26.070284023365858 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.062076590706596 < 29.208450704800896. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 43.91102688625375 (T) = (0 -14.720009080511353) / Math.Sqrt((31.79591394076508 / (299)) + (1.9066837319111345 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5583959134950264 = (33.33304543671963 - 14.720009080511353) / 33.33304543671963 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.940019628026205 < 22.24284140040781. IsChangePoint: Marked as a change because one of 5/14/2023 7:30:23 PM, 5/16/2023 12:30:38 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.81063870426637 (T) = (0 -13.550147475236608) / Math.Sqrt((25.017970088580707 / (299)) + (0.9838922708341334 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4724437861985752 = (25.6847462331985 - 13.550147475236608) / 25.6847462331985 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.961781043905606 < 22.38239405565115. IsChangePoint: Marked as a change because one of 3/17/2023 8:17:18 AM, 3/18/2023 12:49:26 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.13469589875512 (T) = (0 -13.243426230039923) / Math.Sqrt((24.894750020637574 / (299)) + (0.498159719952517 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48697773067563166 = (25.81452506434279 - 13.243426230039923) / 25.81452506434279 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.38069319788916 < 21.92526840030553. IsChangePoint: Marked as a change because one of 3/17/2023 1:34:47 AM, 3/17/2023 1:30:52 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 31.96563176693168 (T) = (0 -12.928194881482918) / Math.Sqrt((22.32420893632256 / (299)) + (0.7932964512343039 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.44501888376674087 = (23.294837433800513 - 12.928194881482918) / 23.294837433800513 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.080121608057084 < 11.532133039059453. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 23.63910181695017 (T) = (0 -7.4774975794143765) / Math.Sqrt((25.5973786291004 / (299)) + (0.22790419656627678 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4926923117560709 = (14.739570782572029 - 7.4774975794143765) / 14.739570782572029 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.89402019295813 < 42.39203886863966. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 109.93333336170956 (T) = (0 -13.072143192284797) / Math.Sqrt((26.62869741512723 / (299)) + (0.19163582403369753 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7231059110963446 = (47.20990341123972 - 13.072143192284797) / 47.20990341123972 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.359352474133727 < 23.22679830263051. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 45.29246753875251 (T) = (0 -13.035940068679519) / Math.Sqrt((20.246068096365214 / (299)) + (0.21802533508600141 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.48939288919563284 = (25.53027522108692 - 13.035940068679519) / 25.53027522108692 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.445673136689612 < 22.16918562435569. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 42.49695614892406 (T) = (0 -13.23709637078408) / Math.Sqrt((23.68002306312627 / (299)) + (0.21027719480333154 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4867832865090132 = (25.792410930546502 - 13.23709637078408) / 25.792410930546502 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.220780798441828 < 41.33008844296376. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 88.76585362816424 (T) = (0 -12.785769486876264) / Math.Sqrt((28.018169656881778 / (299)) + (1.296013815845408 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7245497805822827 = (46.41771392995981 - 12.785769486876264) / 46.41771392995981 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.04751083830552 < 21.50863643314436. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 27.8651625532192 (T) = (0 -12.610775824359239) / Math.Sqrt((43.54086796941728 / (299)) + (0.5557236807278829 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4745050633491167 = (23.997901682423453 - 12.610775824359239) / 23.997901682423453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.90984942724741 < 22.01690646130374. IsChangePoint: Marked as a change because one of 3/22/2023 7:51:01 PM, 3/23/2023 12:23:24 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.91337258034165 (T) = (0 -13.13888862810123) / Math.Sqrt((26.883881699067032 / (299)) + (0.2838378214298276 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.49099416715704847 = (25.812844923046484 - 13.13888862810123) / 25.812844923046484 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).ConditionalSelectBenchmark.html>)	49.97 ns	15.92 ns	0.32	0.30	True
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).AndNotBenchmark.html>)	30.04 ns	13.70 ns	0.46	0.36	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementBenchmark.html>)	23.57 ns	12.28 ns	0.52	0.46	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).XorBenchmark.html>)	23.11 ns	12.93 ns	0.56	0.45	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseAndBenchmark.html>)	25.23 ns	13.26 ns	0.53	0.40	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).OnesComplementOperatorBenchmark.html>)	21.91 ns	11.36 ns	0.52	0.42	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseOrOperatorBenchmark.html>)	23.37 ns	12.78 ns	0.55	0.42	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseAndOperatorBenchmark.html>)	23.41 ns	12.98 ns	0.55	0.44	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).ExclusiveOrOperatorBenchmark.html>)	23.12 ns	13.03 ns	0.56	0.36	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt64).BitwiseOrBenchmark.html>)	22.49 ns	11.73 ns	0.52	0.42	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.92176671825435 < 47.48185611994119. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 93.56547411341325 (T) = (0 -16.219493465954724) / Math.Sqrt((35.13140567136291 / (299)) + (0.7951504284962111 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6903073836877807 = (52.37287752964346 - 16.219493465954724) / 52.37287752964346 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.700674612175108 < 28.952452548793175. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 55.21871097585985 (T) = (0 -14.297167693406207) / Math.Sqrt((26.351011974825994 / (299)) + (0.7081913443240266 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5674436626857557 = (33.052729691068144 - 14.297167693406207) / 33.052729691068144 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.283879068498361 < 21.143994864672912. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 26.73421372509995 (T) = (0 -12.86875018470776) / Math.Sqrt((28.39034860129742 / (299)) + (1.5857177982330464 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4506612670847883 = (23.425892648086773 - 12.86875018470776) / 23.425892648086773 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.93388385580128 < 21.858335176078807. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 30.987551883048035 (T) = (0 -13.391886765064624) / Math.Sqrt((37.94516772800229 / (299)) + (1.3685982055233041 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.495068326950792 = (26.52217612769861 - 13.391886765064624) / 26.52217612769861 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.262043581308424 < 22.247505391188664. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.3283720744996 (T) = (0 -13.482533280969676) / Math.Sqrt((25.59050544286351 / (299)) + (0.6053497167727727 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.477404576049131 = (25.799179753700283 - 13.482533280969676) / 25.799179753700283 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.364551969011037 < 20.904304846901276. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.782690699693475 (T) = (0 -12.532433929862055) / Math.Sqrt((18.875998740850275 / (299)) + (0.4486040284619594 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.46084625252728845 = (23.24463845166237 - 12.532433929862055) / 23.24463845166237 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.781157619722896 < 22.454059721782695. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.70481456775162 (T) = (0 -13.265163555342596) / Math.Sqrt((24.54605284751836 / (299)) + (0.4442184688679672 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4860913198297213 = (25.812297139926322 - 13.265163555342596) / 25.812297139926322 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.982506771321647 < 21.90237331938017. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 38.02641011272056 (T) = (0 -13.074808077591147) / Math.Sqrt((30.077420949499807 / (299)) + (0.3450917639716135 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.49588849361003723 = (25.936341289295903 - 13.074808077591147) / 25.936341289295903 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.030877090569202 < 21.87075607388899. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.67499133346492 (T) = (0 -13.19604372297082) / Math.Sqrt((31.62526859449648 / (299)) + (0.33647803516430186 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.489163911687036 = (25.83224643848235 - 13.19604372297082) / 25.83224643848235 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.727549667579868 < 21.76625958843475. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.5316131122386 (T) = (0 -13.270433837847321) / Math.Sqrt((30.347170401095507 / (299)) + (0.5188689447956197 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.489631883864181 = (26.001690580364933 - 13.270433837847321) / 26.001690580364933 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).AddOperatorBenchmark.html>)	41.27 ns	12.97 ns	0.31	0.31	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SubtractBenchmark.html>)	42.54 ns	13.68 ns	0.32	0.28	True
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).SubtractionOperatorBenchmark.html>)	42.08 ns	13.14 ns	0.31	0.35	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.972042152567129 < 40.47128274395742. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 71.17215603917495 (T) = (0 -13.438197754410147) / Math.Sqrt((21.020769040300433 / (299)) + (2.8274090714494067 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6914603759003533 = (43.55420407872836 - 13.438197754410147) / 43.55420407872836 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.67933166769237 < 39.72358513912343. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 96.16172874769637 (T) = (0 -13.156857677007865) / Math.Sqrt((22.009033769438275 / (299)) + (0.6975837684697267 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6995802783373106 = (43.794920001225336 - 13.156857677007865) / 43.794920001225336 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.143022597293307 < 41.13627337836784. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 84.50895525793099 (T) = (0 -13.237634182154729) / Math.Sqrt((35.05571198369314 / (299)) + (0.4414707409305047 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7004972158196904 = (44.198701585976835 - 13.237634182154729) / 44.198701585976835 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseAndBenchmark.html>)	24.19 ns	13.41 ns	0.55	0.40	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AddOperatorBenchmark.html>)	30.13 ns	12.91 ns	0.43	0.33	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).AndNotBenchmark.html>)	31.88 ns	14.37 ns	0.45	0.39	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseAndOperatorBenchmark.html>)	22.58 ns	12.81 ns	0.57	0.43	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).EqualityOperatorBenchmark.html>)	11.23 ns	7.94 ns	0.71	0.64	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseOrBenchmark.html>)	23.40 ns	12.90 ns	0.55	0.42	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).BitwiseOrOperatorBenchmark.html>)	22.52 ns	13.75 ns	0.61	0.39	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).ExclusiveOrOperatorBenchmark.html>)	23.35 ns	13.86 ns	0.59	0.40	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).ConditionalSelectBenchmark.html>)	50.03 ns	18.14 ns	0.36	0.35	True
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int32).OneBenchmark.html>)	21.92 ns	10.23 ns	0.47	0.49	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.405138167106257 < 22.01725756072164. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 31.83416118570879 (T) = (0 -13.297825663704481) / Math.Sqrt((37.787320297455395 / (299)) + (0.9877795162251913 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.49368153220542094 = (26.26375791036642 - 13.297825663704481) / 26.26375791036642 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.90731995636202 < 28.813993388820567. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 57.812168596137674 (T) = (0 -13.504769026086835) / Math.Sqrt((14.707327201599329 / (299)) + (1.3399056824228308 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5784945915063597 = (32.03937305181837 - 13.504769026086835) / 32.03937305181837 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.367401700722478 < 30.121387040294742. IsChangePoint: Marked as a change because one of 3/22/2023 6:15:16 AM, 3/22/2023 7:51:01 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 58.75279113555947 (T) = (0 -14.222786822872587) / Math.Sqrt((22.608798837199295 / (299)) + (0.5813502083013465 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5650079612117681 = (32.6966600641551 - 14.222786822872587) / 32.6966600641551 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.81203533100595 < 21.48706252291855. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 45.31007012756082 (T) = (0 -13.27572735477806) / Math.Sqrt((19.72702531108123 / (299)) + (0.15390585594072267 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.47784589592830706 = (25.424921974672962 - 13.27572735477806) / 25.424921974672962 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.940544295747387 < 10.79503392051326. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 22.8410630174819 (T) = (0 -7.5362577531386945) / Math.Sqrt((21.263038002458945 / (299)) + (0.6066171784006643 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4822491631941222 = (14.55576160848252 - 7.5362577531386945) / 14.55576160848252 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.89913173276626 < 22.359986442698712. IsChangePoint: Marked as a change because one of 3/21/2023 12:39:01 PM, 3/22/2023 4:29:55 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 38.0787470546885 (T) = (0 -13.361129374857247) / Math.Sqrt((28.658296460909476 / (299)) + (0.27825148095851876 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.48194086987957785 = (25.790742017714216 - 13.361129374857247) / 25.790742017714216 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.753836762382178 < 21.669448188740088. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.234569116586634 (T) = (0 -13.341917487328937) / Math.Sqrt((29.622371179175786 / (299)) + (0.3642397159077004 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48474764819130167 = (25.89394777237716 - 13.341917487328937) / 25.89394777237716 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.86156934970441 < 22.605540977422226. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 44.43844038520012 (T) = (0 -13.353394599511562) / Math.Sqrt((15.298339817581008 / (299)) + (0.5212812385974797 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.47175575036987355 = (25.278826241575807 - 13.353394599511562) / 25.278826241575807 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 18.143253989956502 < 47.444468532039295. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 90.48965908405003 (T) = (0 -16.326529325445758) / Math.Sqrt((42.82835948508991 / (299)) + (0.5918068736427832 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6930807602736994 = (53.19487087223716 - 16.326529325445758) / 53.19487087223716 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int32>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.229024005141294 < 21.045367943706307. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 41.554325585258425 (T) = (0 -11.584280844955085) / Math.Sqrt((17.88672884495923 / (299)) + (0.8881345490530036 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5237372568961944 = (24.323298458032422 - 11.584280844955085) / 24.323298458032422 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).OneBenchmark.html>)	19.75 ns	11.13 ns	0.56	0.58	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).OnesComplementBenchmark.html>)	22.58 ns	12.20 ns	0.54	0.48	False
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).EqualityOperatorBenchmark.html>)	11.87 ns	7.20 ns	0.61	0.64	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).BitwiseAndOperatorBenchmark.html>)	22.56 ns	13.06 ns	0.58	0.40	False
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).BitwiseOrBenchmark.html>)	22.97 ns	13.11 ns	0.57	0.40	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).XorBenchmark.html>)	24.98 ns	12.88 ns	0.52	0.47	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).BitwiseAndBenchmark.html>)	23.49 ns	14.11 ns	0.60	0.40	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).AndNotBenchmark.html>)	30.83 ns	14.39 ns	0.47	0.36	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).OnesComplementOperatorBenchmark.html>)	22.87 ns	12.91 ns	0.56	0.39	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).ExclusiveOrOperatorBenchmark.html>)	23.15 ns	13.26 ns	0.57	0.42	False
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Int64).ConditionalSelectBenchmark.html>)	49.63 ns	15.77 ns	0.32	0.33	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int64>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int64>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.128064174814808 < 19.76949659285941. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 27.881763775970775 (T) = (0 -11.505255379532942) / Math.Sqrt((28.192530455583487 / (299)) + (0.814677752590662 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.46329077445693717 = (21.43666408545798 - 11.505255379532942) / 21.43666408545798 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.19857640327523 < 21.370498029535884. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 39.38874278647931 (T) = (0 -12.647070794874866) / Math.Sqrt((16.034871066473464 / (299)) + (0.39958632889518675 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.449970117119429 = (22.993424882009453 - 12.647070794874866) / 22.993424882009453 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.EqualityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.201234798994768 < 10.609944584658908. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 20.714410491239608 (T) = (0 -7.71234749783598) / Math.Sqrt((27.916523281358796 / (299)) + (0.5788651581725384 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.47734765839558896 = (14.756171328269602 - 7.71234749783598) / 14.756171328269602 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.05988703467855 < 21.92115808722642. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.02947786190534 (T) = (0 -13.036623293407498) / Math.Sqrt((29.85643594851679 / (299)) + (0.5060749232130692 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4952434439765695 = (25.8275462454862 - 13.036623293407498) / 25.8275462454862 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.105806058383832 < 22.497151355039016. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 38.1302289178193 (T) = (0 -13.449677102845449) / Math.Sqrt((19.224028447455016 / (299)) + (0.8530652282773934 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4707288859009396 = (25.41169684980797 - 13.449677102845449) / 25.41169684980797 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.878096460155666 < 22.1378508143916. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.56191433245423 (T) = (0 -13.21239609947192) / Math.Sqrt((37.90454085913396 / (299)) + (0.44703288024621074 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.49872146845099175 = (26.357394677653755 - 13.21239609947192) / 26.357394677653755 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.106049105963232 < 22.164034635522206. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 35.227447193447524 (T) = (0 -13.260485123082024) / Math.Sqrt((36.49326553959145 / (299)) + (0.35387511418302625 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4945605219480019 = (26.235554797161736 - 13.260485123082024) / 26.235554797161736 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.386487157304861 < 29.235994489848924. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 51.65844790716701 (T) = (0 -14.26786235297476) / Math.Sqrt((29.449587837302836 / (299)) + (0.9244158326348981 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.571296418500247 = (33.28141627149663 - 14.26786235297476) / 33.28141627149663 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.905849571420347 < 21.737333616873176. IsChangePoint: Marked as a change because one of 3/16/2023 10:20:48 AM, 3/17/2023 1:34:47 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 32.78544576555824 (T) = (0 -12.608754275805545) / Math.Sqrt((32.92774877403967 / (299)) + (0.18384768478061694 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.47094406796926513 = (23.83255439062548 - 12.608754275805545) / 23.83255439062548 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.262628584969203 < 21.875248964728677. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.86987596707753 (T) = (0 -13.417192211888413) / Math.Sqrt((24.773450724350734 / (299)) + (0.7278017139730766 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4777782767085243 = (25.692520271508634 - 13.417192211888413) / 25.692520271508634 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Int64>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.770882623133701 < 47.99931715035647. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 83.26262414550708 (T) = (0 -16.644065914684678) / Math.Sqrt((34.79112337228803 / (299)) + (1.764243966323855 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6838301952667628 = (52.642806699165405 - 16.644065914684678) / 52.642806699165405 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[BitwiseOrBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseOrBenchmark.html>)	27.52 ns	13.04 ns	0.47	0.42	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementBenchmark.html>)	22.68 ns	12.20 ns	0.54	0.40	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).MultiplyOperatorBenchmark.html>)	45.06 ns	12.60 ns	0.28	0.27	True
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).SubtractBenchmark.html>)	44.24 ns	12.91 ns	0.29	0.17	True
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).OnesComplementOperatorBenchmark.html>)	22.66 ns	12.75 ns	0.56	0.46	False
[InequalityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).InequalityOperatorBenchmark.html>)	10.59 ns	7.94 ns	0.75	0.63	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).UnaryNegateOperatorBenchmark.html>)	44.44 ns	12.05 ns	0.27	0.27	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).AndNotBenchmark.html>)	30.98 ns	12.65 ns	0.41	0.34	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).NegateBenchmark.html>)	44.15 ns	12.23 ns	0.28	0.20	True
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).MultiplyBenchmark.html>)	44.53 ns	14.88 ns	0.33	0.21	True
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).BitwiseAndBenchmark.html>)	23.35 ns	12.82 ns	0.55	0.45	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).SubtractionOperatorBenchmark.html>)	45.66 ns	16.02 ns	0.35	0.18	True
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).AddBenchmark.html>)	47.25 ns	12.38 ns	0.26	0.25	True
[ConditionalSelectBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).ConditionalSelectBenchmark.html>)	58.20 ns	16.75 ns	0.29	0.33	True
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).OneBenchmark.html>)	28.57 ns	11.92 ns	0.42	0.44	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).ExclusiveOrOperatorBenchmark.html>)	23.29 ns	12.93 ns	0.55	0.44	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt16).EqualsAllBenchmark.html>)	11.07 ns	7.14 ns	0.64	0.59	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseOrBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.041744748920122 < 22.20456083101535. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.18057737868339 (T) = (0 -12.958127123432444) / Math.Sqrt((31.001331348371107 / (299)) + (0.5971798832223654 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5052264730838932 = (26.190017085594008 - 12.958127123432444) / 26.190017085594008 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.196741351824077 < 20.54988145163159. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 33.34196261807252 (T) = (0 -12.637133804913333) / Math.Sqrt((21.044820838426507 / (299)) + (0.7627760443465371 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.45449883976859873 = (23.166098857704846 - 12.637133804913333) / 23.166098857704846 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.602193799548647 < 42.44354939123165. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 89.67495428070845 (T) = (0 -13.426483783264532) / Math.Sqrt((34.768805588402735 / (299)) + (0.7191302705652808 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7170330096029752 = (47.4489401199275 - 13.426483783264532) / 47.4489401199275 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.91142090861123 < 42.5137498879425. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 113.0956106895405 (T) = (0 -13.360220464579491) / Math.Sqrt((15.611231960803307 / (299)) + (0.8964943904119675 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7136658254341105 = (46.65953857877736 - 13.360220464579491) / 46.65953857877736 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.75243145098675 < 21.096126804112913. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 35.1732294916456 (T) = (0 -12.49883511587111) / Math.Sqrt((24.886913334691222 / (299)) + (0.3462344503036479 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4665016168021421 = (23.42806559403514 - 12.49883511587111) / 23.42806559403514 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.InequalityOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.941035526619124 < 10.718779323993816. IsChangePoint: Marked as a change because one of 5/4/2023 5:13:34 PM, 5/5/2023 7:39:36 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 20.968310670879003 (T) = (0 -7.473835365068985) / Math.Sqrt((32.83139489070785 / (299)) + (0.519783802667749 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5034444803170101 = (15.051358949429094 - 7.473835365068985) / 15.051358949429094 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.050868429612818 < 41.481128649492426. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 94.84671919617026 (T) = (0 -12.587878099311204) / Math.Sqrt((34.40793548964094 / (299)) + (0.38762017867051896 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7309328025690923 = (46.78339916385972 - 12.587878099311204) / 46.78339916385972 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.649080860224176 < 29.31089555552046. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 58.27880186943211 (T) = (0 -13.847889951393606) / Math.Sqrt((25.40605842772431 / (299)) + (0.5885041976443 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5799238688509388 = (32.965191127414414 - 13.847889951393606) / 32.965191127414414 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.23029693123512 < 41.782610402183494. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 96.01640549067554 (T) = (0 -12.518078697294934) / Math.Sqrt((33.436985984795065 / (299)) + (0.333033055326563 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7303060110517562 = (46.415860976780024 - 12.518078697294934) / 46.415860976780024 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.877842619610025 < 42.17803480226024. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 108.0211445113673 (T) = (0 -13.155611235212135) / Math.Sqrt((25.135899879190706 / (299)) + (0.3292010610345569 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.7191328373472047 = (46.839264195063436 - 13.155611235212135) / 46.839264195063436 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.81860563674288 < 22.21821534790076. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 35.9062981669447 (T) = (0 -13.195424906116422) / Math.Sqrt((36.61952967568102 / (299)) + (0.29495155539933715 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.498850969986461 = (26.330341107833604 - 13.195424906116422) / 26.330341107833604 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 16.017854195794364 < 43.5811155768061. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 91.11429355408593 (T) = (0 -13.39042776164297) / Math.Sqrt((26.689914613659695 / (299)) + (1.2650948652526546 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7164741788483115 = (47.228247879684254 - 13.39042776164297) / 47.228247879684254 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.37729353620881 < 43.51446991305794. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 102.16852799987537 (T) = (0 -13.326049206075428) / Math.Sqrt((26.00356800789878 / (299)) + (0.6258633769416025 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.7186896554908996 = (47.37134437530193 - 13.326049206075428) / 47.37134437530193 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.ConditionalSelectBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 16.753148547872915 < 48.237290373900834. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 100.97759884794336 (T) = (0 -15.942201941059974) / Math.Sqrt((31.3511572551862 / (299)) + (0.6552233755297111 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6955142389925798 = (52.35779134076313 - 15.942201941059974) / 52.35779134076313 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.921090590850966 < 27.248430331850212. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 47.90692445176377 (T) = (0 -11.955695691048039) / Math.Sqrt((30.74996394894144 / (299)) + (1.777705267519968 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6237832446674024 = (31.778743295147784 - 11.955695691048039) / 31.778743295147784 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.925962050122388 < 22.19235663937511. IsChangePoint: Marked as a change because one of 3/16/2023 9:46:36 PM, 3/17/2023 10:06:19 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 19.6585632782807 (T) = (0 -13.775714030506121) / Math.Sqrt((29.183304725560294 / (299)) + (7.267916986015383 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.47069430143009533 = (26.026007405032278 - 13.775714030506121) / 26.026007405032278 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.137464083612206 < 10.895671445626943. IsChangePoint: Marked as a change because one of 3/22/2023 4:29:55 AM, 3/22/2023 1:04:34 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 23.477679807108025 (T) = (0 -7.4936883279085285) / Math.Sqrt((22.406667716909563 / (299)) + (0.3043937675969611 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4804406726470395 = (14.423161963210646 - 7.4936883279085285) / 14.423161963210646 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Widen_byte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_byte.html>)	66.67 μs	49.41 μs	0.74	0.08	False
[Widen_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_int.html>)	40.77 μs	22.16 μs	0.54	0.01	True
[Convert_double_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_double_long.html>)	21.74 μs	11.91 μs	0.55	0.03	True
[Narrow_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_short.html>)	48.90 μs	39.03 μs	0.80	0.03	False
[Widen_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_float.html>)	43.95 μs	24.60 μs	0.56	0.08	True
[Widen_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_uint.html>)	40.38 μs	22.21 μs	0.55	0.01	True
[Widen_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_ushort.html>)	49.18 μs	29.98 μs	0.61	0.02	True
[Widen_short - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_short.html>)	49.16 μs	29.92 μs	0.61	0.03	True
[Narrow_ulong - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong.html>)	23.61 μs	13.71 μs	0.58	0.01	True
[Widen_sbyte - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte.html>)	66.73 μs	49.36 μs	0.74	0.06	False
[Narrow_ushort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort.html>)	48.73 μs	38.86 μs	0.80	0.01	False
[Convert_long_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_long_double.html>)	25.36 μs	15.67 μs	0.62	0.01	True
[Narrow_long - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_long.html>)	23.61 μs	13.72 μs	0.58	0.01	True
[Narrow_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_int.html>)	33.08 μs	23.30 μs	0.70	0.03	True
[Narrow_uint - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_uint.html>)	33.73 μs	23.03 μs	0.68	0.02	True
[Convert_int_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_int_float.html>)	24.71 μs	14.52 μs	0.59	0.02	True
[Narrow_double - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Narrow_double.html>)	28.03 μs	17.25 μs	0.62	0.01	True
[Convert_uint_float - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float.html>)	136.17 μs	84.89 μs	0.62	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorConvert.Widen_byte ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 49.409282502637126 < 63.37163228675912. IsChangePoint: Marked as a change because one of 3/3/2023 8:38:01 AM, 3/21/2023 7:06:30 PM, 4/10/2023 8:15:35 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 46.61922778067461 (T) = (0 -49941.78110952688) / Math.Sqrt((12449704.899004212 / (299)) + (1729287.8346273215 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.2348781697844023 = (65272.97893912421 - 49941.78110952688) / 65272.97893912421 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 22.16303873431533 < 38.78379927922273. IsChangePoint: Marked as a change because one of 5/19/2023 3:32:16 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 119.6762477770886 (T) = (0 -22186.675323042968) / Math.Sqrt((3810185.595443419 / (299)) + (741.0030122032277 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.37873453744490115 = (35712.069413604775 - 22186.675323042968) / 35712.069413604775 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Convert_double_long ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.906411483662614 < 20.64190275548828. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 189.0690057907434 (T) = (0 -11906.252266424532) / Math.Sqrt((521897.11355671764 / (299)) + (3622.0632739150938 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.40843321438040364 = (20126.640906578516 - 11906.252266424532) / 20126.640906578516 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_short ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 39.031249843750004 < 46.439014829852766. IsChangePoint: Marked as a change because one of 3/3/2023 8:38:01 AM, 3/21/2023 7:06:30 PM, 4/10/2023 8:15:35 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 91.58689176794068 (T) = (0 -38953.33911536615) / Math.Sqrt((4163631.1880809823 / (299)) + (57021.69811841673 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.22988239121839027 = (50581.026418800604 - 38953.33911536615) / 50581.026418800604 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 24.59671407480315 < 41.74010475912503. IsChangePoint: Marked as a change because one of 5/19/2023 3:32:16 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 107.60262095463553 (T) = (0 -24630.999731654847) / Math.Sqrt((6140081.5296131065 / (299)) + (2093.0547669398893 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3854669341197828 = (40080.83714157025 - 24630.999731654847) / 40080.83714157025 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_uint ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 22.214408475580843 < 38.36288520118124. IsChangePoint: Marked as a change because one of 5/19/2023 3:32:16 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 110.1198091188162 (T) = (0 -22243.757556948276) / Math.Sqrt((4087351.9216742027 / (299)) + (5935.898365171423 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.3686167319551691 = (35230.198015587695 - 22243.757556948276) / 35230.198015587695 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_ushort ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 29.983786892809686 < 46.72002783706761. IsChangePoint: Marked as a change because one of 3/10/2023 11:41:11 AM, 5/19/2023 3:32:16 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 135.40466454725924 (T) = (0 -29893.852837375165) / Math.Sqrt((3649061.7624539915 / (299)) + (5771.750949992316 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3355120865822223 = (44987.805246323966 - 29893.852837375165) / 44987.805246323966 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_short ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 29.91611750546299 < 46.69906327757836. IsChangePoint: Marked as a change because one of 3/10/2023 11:41:11 AM, 5/19/2023 3:32:16 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 135.6751526622965 (T) = (0 -29890.54527099327) / Math.Sqrt((3658936.3319434905 / (299)) + (4111.686566855095 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.3357617375249331 = (44999.73422129571 - 29890.54527099327) / 44999.73422129571 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.711660133654686 < 22.437170252999007. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 334.3832672459784 (T) = (0 -13721.174023511894) / Math.Sqrt((206947.41450209162 / (299)) + (192.81498133356286 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.39193385572484485 = (22565.265559831834 - 13721.174023511894) / 22565.265559831834 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 49.36198733241324 < 63.3867197088716. IsChangePoint: Marked as a change because one of 3/3/2023 8:38:01 AM, 3/21/2023 7:06:30 PM, 4/10/2023 8:15:35 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 46.16199816268597 (T) = (0 -49959.933706739714) / Math.Sqrt((10290255.039989235 / (299)) + (1844273.0829670609 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.2330776619639936 = (65143.406612305684 - 49959.933706739714) / 65143.406612305684 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 38.8604375942211 < 46.29619415978249. IsChangePoint: Marked as a change because one of 3/3/2023 8:38:01 AM, 3/21/2023 7:06:30 PM, 4/10/2023 8:15:35 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 98.2887035499768 (T) = (0 -38762.85859299027) / Math.Sqrt((3290326.337913381 / (299)) + (86813.36363139749 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.23293971317775702 = (50534.30513731328 - 38762.85859299027) / 50534.30513731328 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Convert_long_double ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.665056001159645 < 24.08133117104157. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 226.93545643813093 (T) = (0 -15677.517541940466) / Math.Sqrt((387433.0258349882 / (299)) + (1157.0832651468752 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3463763808934586 = (23985.543183660586 - 15677.517541940466) / 23985.543183660586 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_long ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.724054444932632 < 22.453361719213632. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 236.26469714593037 (T) = (0 -13764.116944469048) / Math.Sqrt((231259.31222449348 / (299)) + (15370.573518172347 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3880414406073785 = (22491.910168116858 - 13764.116944469048) / 22491.910168116858 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 23.300510944485843 < 31.41960037798859. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 139.04664517655192 (T) = (0 -23312.413194201497) / Math.Sqrt((1509838.013246693 / (299)) + (991.2604961358763 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.2984612077844185 = (33230.39788088816 - 23312.413194201497) / 33230.39788088816 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_uint ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 23.02991523774458 < 31.377683526502565. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 141.4055736842701 (T) = (0 -23075.528446518292) / Math.Sqrt((1534272.1278718517 / (299)) + (1889.7538358699585 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3065492689493089 = (33276.37770538521 - 23075.528446518292) / 33276.37770538521 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Convert_int_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.516868712624582 < 23.46672327415094. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 276.73232712814576 (T) = (0 -14512.47992268837) / Math.Sqrt((308590.93677839084 / (299)) + (314.10856402757724 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3812536357844705 = (23454.65082625229 - 14512.47992268837) / 23454.65082625229 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Narrow_double ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 17.251362978107164 < 26.63468636825024. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 60.308314722180604 (T) = (0 -17611.77980536197) / Math.Sqrt((84094.71286116827 / (299)) + (718917.2071347341 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3639893568891675 = (27691.014287465165 - 17611.77980536197) / 27691.014287465165 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 84.88869545218294 < 130.6412672583018. IsChangePoint: Marked as a change because one of 4/6/2023 3:49:07 PM, 4/7/2023 2:04:47 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 18.253011429734467 (T) = (0 -86284.92218702959) / Math.Sqrt((2796941568.843455 / (299)) + (2972747.969477029 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.39428602217972486 = (142451.59488895215 - 86284.92218702959) / 142451.59488895215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).UnaryNegateOperatorBenchmark.html>)	28.56 ns	12.54 ns	0.44	0.36	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).ExclusiveOrOperatorBenchmark.html>)	22.88 ns	17.41 ns	0.76	0.41	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseAndOperatorBenchmark.html>)	24.09 ns	12.91 ns	0.54	0.46	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).NegateBenchmark.html>)	31.18 ns	12.57 ns	0.40	0.40	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).AddOperatorBenchmark.html>)	30.20 ns	13.16 ns	0.44	0.34	False
[EqualsAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).EqualsAllBenchmark.html>)	11.57 ns	8.13 ns	0.70	0.61	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementBenchmark.html>)	23.19 ns	13.11 ns	0.57	0.47	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractBenchmark.html>)	30.77 ns	12.97 ns	0.42	0.36	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).SubtractionOperatorBenchmark.html>)	31.93 ns	12.79 ns	0.40	0.36	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).MultiplyBenchmark.html>)	30.09 ns	13.00 ns	0.43	0.39	False
[OneBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OneBenchmark.html>)	22.13 ns	11.19 ns	0.51	0.54	False
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).MultiplyOperatorBenchmark.html>)	29.91 ns	11.97 ns	0.40	0.40	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).BitwiseOrOperatorBenchmark.html>)	23.08 ns	13.89 ns	0.60	0.42	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(UInt32).OnesComplementOperatorBenchmark.html>)	22.55 ns	11.98 ns	0.53	0.45	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt32>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<UInt32>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.54101014661499 < 27.702165052841572. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 62.42602705817776 (T) = (0 -12.399049924543974) / Math.Sqrt((25.756875291010548 / (299)) + (0.329571034993859 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6134149377429658 = (32.07327735881333 - 12.399049924543974) / 32.07327735881333 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 17.4149024986905 < 21.966392396477662. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 32.59115732153846 (T) = (0 -13.207476571784737) / Math.Sqrt((34.213130319447835 / (299)) + (1.037071346504817 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4935037299745032 = (26.076157621298726 - 13.207476571784737) / 26.076157621298726 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.911879114120236 < 22.333486184146782. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.38555085991016 (T) = (0 -13.273973526944221) / Math.Sqrt((36.777733095056625 / (299)) + (0.6380521456149786 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4987532820521625 = (26.481916093714123 - 13.273973526944221) / 26.481916093714123 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.57132706471511 < 28.286342209737512. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 53.274795649693665 (T) = (0 -12.610551380791165) / Math.Sqrt((29.379344231625236 / (299)) + (0.9603668799569615 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6096517777861976 = (32.30590191822133 - 12.610551380791165) / 32.30590191822133 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.164910122752 < 29.377607626169855. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 62.3754003952757 (T) = (0 -13.337198906533883) / Math.Sqrt((24.282813576044855 / (299)) + (0.3375046803085461 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5893832885238698 = (32.48089649977433 - 13.337198906533883) / 32.48089649977433 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAllBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.12898046084684 < 10.877338607492888. IsChangePoint: Marked as a change because one of 5/29/2023 7:53:51 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 17.253802294605492 (T) = (0 -7.405273512063955) / Math.Sqrt((24.869770351211603 / (299)) + (2.583850193005009 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.49632635244927964 = (14.702523247095705 - 7.405273512063955) / 14.702523247095705 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.108472154056988 < 20.83837375924943. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.16103369005056 (T) = (0 -12.385711419698865) / Math.Sqrt((28.4581349714071 / (299)) + (0.32065018131094 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4754565671118715 = (23.612365808305555 - 12.385711419698865) / 23.612365808305555 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.971395226592033 < 29.000758059896388. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 50.45180971359096 (T) = (0 -13.267826796797134) / Math.Sqrt((37.01917659863464 / (299)) + (0.7267293429835554 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5978759606829275 = (32.99436367775946 - 13.267826796797134) / 32.99436367775946 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.790394362902076 < 29.88148690770679. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 59.29589427214855 (T) = (0 -13.255710666137665) / Math.Sqrt((27.6196681289854 / (299)) + (0.3515761915133989 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5927778823678854 = (32.55154887759045 - 13.255710666137665) / 32.55154887759045 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.001164197646794 < 28.677418746934713. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 24.159703828389933 (T) = (0 -14.119799190745479) / Math.Sqrt((21.885734544266626 / (299)) + (13.403001427178548 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5676294472195856 = (32.65670869569238 - 14.119799190745479) / 32.65670869569238 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OneBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.194594055441064 < 21.922203734496275. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 33.1362009291611 (T) = (0 -11.955905696419315) / Math.Sqrt((25.395112442387376 / (299)) + (1.7255011120411825 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5187791855893715 = (24.844947139417105 - 11.955905696419315) / 24.844947139417105 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.966530698107606 < 28.958858539846975. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 59.18415940829242 (T) = (0 -13.503060654229346) / Math.Sqrt((20.679616733641815 / (299)) + (0.882091090624835 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5861800855066917 = (32.63028235546091 - 13.503060654229346) / 32.63028235546091 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.885981230545656 < 22.778149834826486. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 34.714628431348565 (T) = (0 -13.596009806164231) / Math.Sqrt((22.84198929027786 / (299)) + (1.1234480438540018 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.46894028341333754 = (25.601659063035953 - 13.596009806164231) / 25.601659063035953 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.979932065135 < 20.959536363250738. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.463527776941675 (T) = (0 -12.23406556729806) / Math.Sqrt((26.05883450450932 / (299)) + (0.2600219448819942 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48211125640606345 = (23.62296095180335 - 12.23406556729806) / 23.62296095180335 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[MultiplyOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).MultiplyOperatorBenchmark.html>)	35.72 ns	13.28 ns	0.37	0.34	False
[BitwiseAndBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseAndBenchmark.html>)	23.83 ns	12.96 ns	0.54	0.42	False
[AndNotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AndNotBenchmark.html>)	31.64 ns	13.70 ns	0.43	0.33	False
[UnaryNegateOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).UnaryNegateOperatorBenchmark.html>)	34.16 ns	12.32 ns	0.36	0.34	True
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementBenchmark.html>)	22.69 ns	12.17 ns	0.54	0.47	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseOrOperatorBenchmark.html>)	23.10 ns	12.24 ns	0.53	0.43	False
[XorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).XorBenchmark.html>)	22.64 ns	13.19 ns	0.58	0.45	False
[NegateBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).NegateBenchmark.html>)	36.24 ns	11.92 ns	0.33	0.36	False
[SubtractBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).SubtractBenchmark.html>)	34.51 ns	14.16 ns	0.41	0.27	False
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).ExclusiveOrOperatorBenchmark.html>)	23.18 ns	13.13 ns	0.57	0.46	False
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AddOperatorBenchmark.html>)	33.90 ns	12.86 ns	0.38	0.30	False
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).AddBenchmark.html>)	34.06 ns	13.28 ns	0.39	0.29	False
[SubtractionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).SubtractionOperatorBenchmark.html>)	35.72 ns	12.90 ns	0.36	0.36	False
[MultiplyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).MultiplyBenchmark.html>)	36.01 ns	13.25 ns	0.37	0.32	False
[DivisionOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).DivisionOperatorBenchmark.html>)	35.91 ns	12.89 ns	0.36	0.33	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).BitwiseAndOperatorBenchmark.html>)	22.88 ns	13.96 ns	0.61	0.42	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Single).OnesComplementOperatorBenchmark.html>)	23.44 ns	12.36 ns	0.53	0.42	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Single>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.279618599251256 < 35.02473947354866. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 75.09002908053397 (T) = (0 -13.26228790774814) / Math.Sqrt((29.440845123916592 / (299)) + (0.3554960989764527 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6552461488954221 = (38.46886079809198 - 13.26228790774814) / 38.46886079809198 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.959968878558795 < 22.348746855979382. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 43.633573849061754 (T) = (0 -13.120191241474386) / Math.Sqrt((20.43618642815265 / (299)) + (0.3556366395058028 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.48866289698960963 = (25.658594231148104 - 13.120191241474386) / 25.658594231148104 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.AndNotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.699178384121764 < 30.607200648386616. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 51.65596375275497 (T) = (0 -14.175473428487932) / Math.Sqrt((28.47834014570185 / (299)) + (1.00795254201571 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.5715510021049441 = (33.08555626954709 - 14.175473428487932) / 33.08555626954709 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.UnaryNegateOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.322776128135311 < 33.55656845622155. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 81.92702107988991 (T) = (0 -12.900867855373567) / Math.Sqrt((13.397984838207208 / (299)) + (1.1894101515897195 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6564784628966928 = (37.55475701511516 - 12.900867855373567) / 37.55475701511516 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.174147605812353 < 20.66545636803421. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 28.68537473839914 (T) = (0 -12.848116538679438) / Math.Sqrt((35.19083137944679 / (299)) + (0.8121445551255745 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4628325590766652 = (23.918271212780258 - 12.848116538679438) / 23.918271212780258 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.235636551149245 < 21.96751546687085. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 31.37700876610354 (T) = (0 -13.54264508682689) / Math.Sqrt((27.548369581474823 / (299)) + (1.5468869314448737 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4742922013209076 = (25.76078407216805 - 13.54264508682689) / 25.76078407216805 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.XorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.187459886936749 < 21.65267042129599. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.79197418119678 (T) = (0 -13.176917016476661) / Math.Sqrt((31.256117886756115 / (299)) + (0.36918359300453857 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.4909430235963607 = (25.884955176468257 - 13.176917016476661) / 25.884955176468257 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.NegateBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.920761496471611 < 34.043916538086656. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 79.23666823175306 (T) = (0 -12.334233672592001) / Math.Sqrt((29.876792135545276 / (299)) + (0.22910133952271605 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6796694595123304 = (38.50470721216411 - 12.334233672592001) / 38.50470721216411 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.SubtractBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.15952758657262 < 33.97479079740061. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 77.66182228733243 (T) = (0 -13.391883704953175) / Math.Sqrt((27.218504402531327 / (299)) + (0.3651909083315428 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6527585261697884 = (38.56648676563708 - 13.391883704953175) / 38.56648676563708 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.132688908616856 < 22.000662856777907. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 23.604200770003146 (T) = (0 -13.76740258229585) / Math.Sqrt((28.49636472946217 / (299)) + (4.382755671332081 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.46828701095796094 = (25.892545162569558 - 13.76740258229585) / 25.892545162569558 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.85516446296932 < 33.97929025721007. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 75.33568115004279 (T) = (0 -13.0694495161046) / Math.Sqrt((29.602343735762382 / (299)) + (0.38238680368943717 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6603001080310795 = (38.473516845570074 - 13.0694495161046) / 38.473516845570074 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.27709869212935 < 35.37947192238334. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 76.2257503563114 (T) = (0 -13.47878489837769) / Math.Sqrt((25.750895106514225 / (299)) + (0.4959788020043061 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6479972782034836 = (38.29170646631939 - 13.47878489837769) / 38.29170646631939 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.SubtractionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.902668368381168 < 35.349632187515475. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 67.97743123883689 (T) = (0 -13.402916110380234) / Math.Sqrt((29.140607605755655 / (299)) + (0.9981097867118057 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6527655940127767 = (38.59904398665321 - 13.402916110380234) / 38.59904398665321 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.245067344002441 < 34.87177030185591. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 67.981250599637 (T) = (0 -13.789609273297499) / Math.Sqrt((24.205302926212216 / (299)) + (1.278980395897893 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6400926764805019 = (38.314333641367114 - 13.789609273297499) / 38.314333641367114 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.DivisionOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.892729279700847 < 34.2721890408406. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 52.26544269130142 (T) = (0 -14.252159862069417) / Math.Sqrt((18.076386239340575 / (299)) + (4.037193805695445 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6300822446953237 = (38.52791507758495 - 14.252159862069417) / 38.52791507758495 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.955895268051423 < 22.01447381511787. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 38.477172010902066 (T) = (0 -13.726791233513998) / Math.Sqrt((17.221173133371664 / (299)) + (0.8728800128954124 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4583942061109054 = (25.344616672111993 - 13.726791233513998) / 25.344616672111993 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.362247886044369 < 21.0158848126647. IsChangePoint: Marked as a change because one of 3/16/2023 10:20:48 AM, 3/17/2023 1:34:47 AM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 29.597912925697052 (T) = (0 -12.642979723451) / Math.Sqrt((28.414352029071516 / (299)) + (1.0533380132994192 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4629115714772566 = (23.539847540982024 - 12.642979723451) / 23.539847540982024 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[AddBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddBenchmark.html>)	41.68 ns	12.93 ns	0.31	0.30	True
[AddOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddOperatorBenchmark.html>)	41.86 ns	13.38 ns	0.32	0.28	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.926599159246944 < 39.349958233082646. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 92.03284391203995 (T) = (0 -13.308516660626191) / Math.Sqrt((23.340417140016566 / (299)) + (0.7756671144508509 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.6954962940487509 = (43.70559832449749 - 13.308516660626191) / 43.70559832449749 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms #### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.376708793866584 < 40.13867061245089. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 91.12039953349091 (T) = (0 -13.225180696103852) / Math.Sqrt((26.309579815896573 / (299)) + (0.5982912183506311 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.696557987762006 = (43.5838814756183 - 13.225180696103852) / 43.5838814756183 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	93da0c966f9bc537dd77fbe2cbeb0bec4ff6a48b
Compare	b134fa28352ee718517aaee2920daa2498ed07df
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ExclusiveOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).ExclusiveOrOperatorBenchmark.html>)	22.94 ns	13.74 ns	0.60	0.43	False
[BitwiseOrOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseOrOperatorBenchmark.html>)	25.65 ns	11.63 ns	0.45	0.43	False
[OnesComplementBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementBenchmark.html>)	22.41 ns	12.19 ns	0.54	0.47	False
[BitwiseAndOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).BitwiseAndOperatorBenchmark.html>)	23.59 ns	13.11 ns	0.56	0.41	False
[OnesComplementOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompilationMode=wasm_RunKind=micro/System.Numerics.Tests.Perf_VectorOf(Double).OnesComplementOperatorBenchmark.html>)	22.08 ns	12.28 ns	0.56	0.47	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Double>.ExclusiveOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.739839548289654 < 21.796180210679168. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 31.523479679079802 (T) = (0 -13.679693344285862) / Math.Sqrt((30.506223631403287 / (299)) + (1.2858789101682715 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4728227604512057 = (25.94894528450085 - 13.679693344285862) / 25.94894528450085 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseOrOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.625828841213304 < 22.18652205891969. IsChangePoint: Marked as a change because one of 5/15/2023 6:46:12 PM, 5/17/2023 4:23:45 PM, 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 36.32061124456926 (T) = (0 -13.083290724455946) / Math.Sqrt((27.882210444710683 / (299)) + (0.7969655457478755 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.495462396971707 = (25.93125001175041 - 13.083290724455946) / 25.93125001175041 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.191233672700756 < 20.645558177646848. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 38.2238936557317 (T) = (0 -12.424445725322954) / Math.Sqrt((18.434163512428682 / (299)) + (0.44249158244843684 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.4632062551313197 = (23.145660403256812 - 12.424445725322954) / 23.145660403256812 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseAndOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 13.11088936228673 < 22.082464569153494. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 37.79870615693039 (T) = (0 -13.3475064356151) / Math.Sqrt((21.557068522921792 / (299)) + (0.80028385317932 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.47597763063214743 = (25.47125316752544 - 13.3475064356151) / 25.47125316752544 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms #### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 12.279945234465565 < 20.598250160328327. IsChangePoint: Marked as a change because one of 5/29/2023 10:47:10 AM, 6/5/2023 10:09:45 PM falls between 5/27/2023 6:38:16 PM and 6/5/2023 10:09:45 PM. IsImprovementStdDev: Marked as improvement because 29.689406446424904 (T) = (0 -12.88150114434585) / Math.Sqrt((28.334756946318215 / (299)) + (0.9784253888965843 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.45611873625063143 = (23.684399524161407 - 12.88150114434585) / 23.684399524161407 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[kg]

https://github.com/dotnet/runtime/commit/1d2a2036004ad763b488963a0be44c806d6cd31a