search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 30 Improvements on 3/6/2023 8:17:12 PM #13805

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c7537bdf261a7160836447ec46e1f136580a9fe4
Compare 27f781f9e3441c6b501e1f090989238ffea97596
Diff Diff

Improvements in StoreBlock.AnyLocation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros8.html>) 17.20 ns 6.71 ns 0.39 0.07 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros64.html>) 23.02 ns 6.99 ns 0.30 0.07 False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock16.html>) 22.86 ns 8.06 ns 0.35 0.05 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes64.html>) 22.35 ns 6.98 ns 0.31 0.05 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock64.html>) 25.18 ns 8.61 ns 0.34 0.11 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes32.html>) 20.83 ns 6.74 ns 0.32 0.13 False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes8.html>) 17.09 ns 6.69 ns 0.39 0.08 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros32.html>) 20.94 ns 6.75 ns 0.32 0.08 False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock128.html>) 28.76 ns 10.48 ns 0.36 0.08 False
[InitBlockAllOnes128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes128.html>) 24.16 ns 7.75 ns 0.32 0.09 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros128.html>) 24.84 ns 7.73 ns 0.31 0.08 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock32.html>) 25.12 ns 8.51 ns 0.34 0.04 False
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock8.html>) 22.02 ns 8.03 ns 0.36 0.05 False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes16.html>) 18.80 ns 6.69 ns 0.36 0.06 False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros16.html>) 18.65 ns 6.69 ns 0.36 0.08 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.AnyLocation*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.AnyLocation.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.712963159455216 < 16.355865685039678. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 430.19615719284656 (T) = (0 -6.694310881344977) / Math.Sqrt((0.16813029249605538 / (299)) + (0.0001224264127295741 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.608870008976671 = (17.11530957733613 - 6.694310881344977) / 17.11530957733613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.986282184876363 < 21.275167629316467. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 83.05424428353155 (T) = (0 -7.099592294132809) / Math.Sqrt((0.22712133855605632 / (299)) + (0.16360859233375255 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6815866051789019 = (22.29677648492691 - 7.099592294132809) / 22.29677648492691 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.059319935260904 < 21.61005555550685. IsChangePoint: Marked as a change because one of 2/17/2023 12:34:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 336.0033666181273 (T) = (0 -8.059504197524243) / Math.Sqrt((0.5074609845851428 / (299)) + (1.855882158521797E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6322710205491582 = (21.916967788505882 - 8.059504197524243) / 21.916967788505882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.982978642756647 < 21.223911738479813. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 363.81770062929473 (T) = (0 -6.88830075436474) / Math.Sqrt((0.3098700664421216 / (299)) + (0.0038239944651337686 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6915049546112937 = (22.328724098908697 - 6.88830075436474) / 22.328724098908697 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.614207580937624 < 23.897866790016263. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 366.7327039408354 (T) = (0 -8.635393760938767) / Math.Sqrt((0.49023683514786465 / (299)) + (0.0020224289194598513 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6575417952485105 = (25.215905594100693 - 8.635393760938767) / 25.215905594100693 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.737153279746074 < 19.79819857826255. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 38.0082062603459 (T) = (0 -7.099713927026324) / Math.Sqrt((2.103471017129498 / (299)) + (0.6459400382774574 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6639655734471568 = (21.12793620539905 - 7.099713927026324) / 21.12793620539905 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.693991252418401 < 16.25771660064526. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 380.9033779182224 (T) = (0 -6.690970358073384) / Math.Sqrt((0.22234007571502293 / (299)) + (3.792266085887795E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.60941774653004 = (17.13075875473178 - 6.690970358073384) / 17.13075875473178 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.745815066530571 < 19.884643157711466. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 331.1009170331669 (T) = (0 -6.756750392295475) / Math.Sqrt((0.5388391074994223 / (299)) + (0.0003283762829476623 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6792631397499733 = (21.066335771411897 - 6.756750392295475) / 21.066335771411897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.481086082012759 < 27.273425397005784. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 388.58875068495854 (T) = (0 -10.485528347646376) / Math.Sqrt((0.6238761377489513 / (299)) + (0.0008144033498383443 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6373740323259641 = (28.915547374896786 - 10.485528347646376) / 28.915547374896786 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.754396318643435 < 22.931335520749595. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 8.768153658622852 (T) = (0 -9.427662461879365) / Math.Sqrt((0.45656232543350583 / (299)) + (14.022567330906615 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6090606137893358 = (24.11540713065711 - 9.427662461879365) / 24.11540713065711 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.727733376777031 < 23.083618487425486. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 358.02403294768305 (T) = (0 -7.765058135009165) / Math.Sqrt((0.2999165711717889 / (299)) + (0.005517514495155324 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6790956009918294 = (24.197418792041734 - 7.765058135009165) / 24.197418792041734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.511739084037524 < 23.87179224450254. IsChangePoint: Marked as a change because one of 2/17/2023 12:34:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 338.75329620017163 (T) = (0 -8.510596525324) / Math.Sqrt((0.6055035390844158 / (299)) + (6.685688661106043E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6424885051328163 = (23.805098989854034 - 8.510596525324) / 23.805098989854034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.027799382362293 < 20.924605466390112. IsChangePoint: Marked as a change because one of 2/17/2023 12:34:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 277.2531840179041 (T) = (0 -8.02698047782529) / Math.Sqrt((0.6607783714650934 / (299)) + (1.100487853855594E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6189821525583644 = (21.067203365204215 - 8.02698047782529) / 21.067203365204215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.687225599850501 < 17.86103879401882. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 90.86147499090191 (T) = (0 -6.838188464607223) / Math.Sqrt((0.36315451619849987 / (299)) + (0.08222942252676432 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6384399281438988 = (18.913007815002267 - 6.838188464607223) / 18.913007815002267 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.6851655511112495 < 17.727435976272755. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 484.468076112405 (T) = (0 -6.693789509183189) / Math.Sqrt((0.15872563651652027 / (299)) + (0.0004794945772867998 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6443724842792822 = (18.82247355246822 - 6.693789509183189) / 18.82247355246822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c7537bdf261a7160836447ec46e1f136580a9fe4
Compare 27f781f9e3441c6b501e1f090989238ffea97596
Diff Diff

Improvements in StoreBlock.LocalAddress

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock8.html>) 15.77 ns 6.01 ns 0.38 0.11 False
[InitBlockAllOnes128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes128.html>) 21.77 ns 15.36 ns 0.71 0.16 False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes16.html>) 16.31 ns 5.57 ns 0.34 0.09 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros128.html>) 21.72 ns 6.47 ns 0.30 0.19 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock64.html>) 20.21 ns 6.46 ns 0.32 0.14 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros32.html>) 18.34 ns 5.75 ns 0.31 0.15 False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes8.html>) 14.43 ns 6.71 ns 0.47 0.06 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros64.html>) 20.51 ns 5.91 ns 0.29 0.16 False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros8.html>) 14.45 ns 5.69 ns 0.39 0.06 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock32.html>) 18.39 ns 6.22 ns 0.34 0.15 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes64.html>) 19.98 ns 5.87 ns 0.29 0.13 False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros16.html>) 16.00 ns 5.59 ns 0.35 0.08 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes32.html>) 18.34 ns 5.72 ns 0.31 0.11 False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock128.html>) 23.42 ns 8.70 ns 0.37 0.23 False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock16.html>) 16.52 ns 5.93 ns 0.36 0.07 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.LocalAddress*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.LocalAddress.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.012685206963338 < 14.995179484492295. IsChangePoint: Marked as a change because one of 2/17/2023 12:34:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 189.1486796044044 (T) = (0 -6.007977016661587) / Math.Sqrt((0.7276085750795549 / (299)) + (3.9870939900561355E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6087029114857087 = (15.35400388352789 - 6.007977016661587) / 15.35400388352789 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 15.360994162911112 < 20.11773186884939. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 7.332757099525195 (T) = (0 -8.264068943681547) / Math.Sqrt((0.8277234275151538 / (299)) + (15.740010715562521 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6116511368724241 = (21.280013226063524 - 8.264068943681547) / 21.280013226063524 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.570976280848819 < 15.474722355714439. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 207.93765288878055 (T) = (0 -5.605236653239213) / Math.Sqrt((0.5800283403688986 / (299)) + (0.0035541365050043286 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6563510835905073 = (16.31093940817204 - 5.605236653239213) / 16.31093940817204 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.4703143069552285 < 20.17393097278518. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 232.6763411897333 (T) = (0 -6.477225045518262) / Math.Sqrt((1.2132883949475712 / (299)) + (0.0001591285994624633 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6967159204323214 = (21.356956998043984 - 6.477225045518262) / 21.356956998043984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.4593308867358505 < 19.22445414015947. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 288.3690650191245 (T) = (0 -6.46352385987989) / Math.Sqrt((0.6864263017609012 / (299)) + (9.122137023359322E-06 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6813784137485527 = (20.28589442392348 - 6.46352385987989) / 20.28589442392348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.748554716246341 < 17.42685737177337. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 208.70456304491137 (T) = (0 -5.7425132287627125) / Math.Sqrt((1.10171748241935 / (299)) + (0.0007965315619497701 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6926205330838212 = (18.682162755941906 - 5.7425132287627125) / 18.682162755941906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.710319888942399 < 13.707392520877603. IsChangePoint: Marked as a change because one of 1/16/2023 10:36:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 42.93120756953681 (T) = (0 -6.002248916435647) / Math.Sqrt((0.1372938234318162 / (299)) + (0.19287976025690143 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.5856031230925145 = (14.484300560439925 - 6.002248916435647) / 14.484300560439925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.914475893566886 < 18.805406101851318. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 63.10275675998738 (T) = (0 -6.101516685788722) / Math.Sqrt((1.07851178734515 / (299)) + (0.21815805736839103 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6921001077529217 = (19.81655999051952 - 6.101516685788722) / 19.81655999051952 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.692678900345599 < 13.724099948880209. IsChangePoint: Marked as a change because one of 1/16/2023 10:36:41 AM, 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 200.06068070975445 (T) = (0 -5.769072850441894) / Math.Sqrt((0.18322593758410707 / (299)) + (0.006373952998416079 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.601059388537702 = (14.460981621539181 - 5.769072850441894) / 14.460981621539181 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.217814439068598 < 17.446267351254537. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 89.14098742674783 (T) = (0 -6.322334925798126) / Math.Sqrt((0.34633580845326 / (299)) + (0.08576908507623353 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6561163757085963 = (18.38510030486546 - 6.322334925798126) / 18.38510030486546 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.870998149121442 < 18.980471804804242. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 367.71147699836 (T) = (0 -5.8675649744307155) / Math.Sqrt((0.4197838920883758 / (299)) + (5.5994277681655874E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.7021593915463044 = (19.700352496905833 - 5.8675649744307155) / 19.700352496905833 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.594168307147833 < 15.204718974296226. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 164.13986128159456 (T) = (0 -5.603750229688658) / Math.Sqrt((1.0981200344365352 / (299)) + (0.002356020294853343 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6534451263613863 = (16.16987858474681 - 5.603750229688658) / 16.16987858474681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.72044531133134 < 17.41946883076809. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 246.8568909172235 (T) = (0 -5.75107484300325) / Math.Sqrt((0.7210203911192958 / (299)) + (0.0015142399042643692 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6910022537599436 = (18.612028446755446 - 5.75107484300325) / 18.612028446755446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.700541979097867 < 23.193468556945408. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 58.57670361953288 (T) = (0 -9.47289484301577) / Math.Sqrt((0.8424392983826464 / (299)) + (0.2825733774384914 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6009921897978231 = (23.741126365962266 - 9.47289484301577) / 23.741126365962266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.927531995699224 < 15.70247680718116. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/7/2023 7:56:26 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 7:56:26 PM. IsImprovementStdDev: Marked as improvement because 366.77048860647454 (T) = (0 -5.923420392033078) / Math.Sqrt((0.24358587864167844 / (299)) + (2.6725285422479806E-05 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.6393922657373494 = (16.42621560556636 - 5.923420392033078) / 16.42621560556636 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
kg commented 1 year ago

Expected since we added initblk and cpblk support to the jiterpreter

lewing commented 1 year ago

yup https://github.com/dotnet/runtime/pull/83033