search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 29 Improvements on 3/6/2023 8:17:12 PM #14056

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c7537bdf261a7160836447ec46e1f136580a9fe4
Compare 27f781f9e3441c6b501e1f090989238ffea97596
Diff Diff

Improvements in StoreBlock.LocalAddress

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock128.html>) 23.51 ns 8.98 ns 0.38 0.23 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock32.html>) 18.35 ns 7.53 ns 0.41 0.16 False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros8.html>) 14.45 ns 6.05 ns 0.42 0.06 False
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock16.html>) 16.52 ns 6.34 ns 0.38 0.08 False
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock8.html>) 15.88 ns 6.38 ns 0.40 0.11 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes32.html>) 18.52 ns 5.88 ns 0.32 0.10 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes64.html>) 24.62 ns 6.08 ns 0.25 0.13 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros32.html>) 18.37 ns 5.87 ns 0.32 0.14 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros128.html>) 21.08 ns 6.55 ns 0.31 0.17 False
[InitBlockAllOnes128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes128.html>) 21.23 ns 6.52 ns 0.31 0.16 False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllOnes8.html>) 14.43 ns 6.12 ns 0.42 0.08 False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros16.html>) 16.00 ns 5.75 ns 0.36 0.08 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.CopyBlock64.html>) 22.66 ns 7.42 ns 0.33 0.15 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.LocalAddress.InitBlockAllZeros64.html>) 19.77 ns 6.04 ns 0.31 0.16 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.LocalAddress*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.LocalAddress.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.98106064013948 < 22.31351478398595. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 171.96086009685186 (T) = (0 -9.043668911728721) / Math.Sqrt((0.8424392983826464 / (299)) + (0.1525770782814008 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6190716155449701 = (23.741126365962266 - 9.043668911728721) / 23.741126365962266 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.532736742424243 < 17.432780909087477. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 141.3148730716493 (T) = (0 -6.6122608395935245) / Math.Sqrt((0.34633580845326 / (299)) + (0.19659212675730767 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6403467628706031 = (18.38510030486546 - 6.6122608395935245) / 18.38510030486546 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.051692802317983 < 13.721147621683315. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 212.91224137360192 (T) = (0 -5.896293558040859) / Math.Sqrt((0.18322593758410707 / (299)) + (0.03418243104198288 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.5922618732010203 = (14.460981621539181 - 5.896293558040859) / 14.460981621539181 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.340123395644388 < 15.71519653830037. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 209.67206214602177 (T) = (0 -6.180810896724504) / Math.Sqrt((0.24358587864167844 / (299)) + (0.053482574884412576 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6237227706526627 = (16.42621560556636 - 6.180810896724504) / 16.42621560556636 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.381268349983069 < 15.073345951723153. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 140.6835195748264 (T) = (0 -6.231424667517702) / Math.Sqrt((0.7276085750795549 / (299)) + (0.06022625111577794 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.5941498572758008 = (15.35400388352789 - 6.231424667517702) / 15.35400388352789 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.883501044818144 < 17.448080453651702. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 243.29286892061668 (T) = (0 -5.82692595986312) / Math.Sqrt((0.7210203911192958 / (299)) + (0.011903058146614956 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6869268722357394 = (18.612028446755446 - 5.82692595986312) / 18.612028446755446 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.080341594158337 < 18.65138477540735. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 293.504909219534 (T) = (0 -6.013470860765843) / Math.Sqrt((0.4197838920883758 / (299)) + (0.02620158952214523 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6947531338989834 = (19.700352496905833 - 6.013470860765843) / 19.700352496905833 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.865824324845679 < 17.425138918979858. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 205.01864995576227 (T) = (0 -5.817127143468697) / Math.Sqrt((1.10171748241935 / (299)) + (0.008600614252955921 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6886266745739305 = (18.682162755941906 - 5.817127143468697) / 18.682162755941906 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.546369510393134 < 20.031275040340894. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 209.03995768532582 (T) = (0 -6.563917855409309) / Math.Sqrt((1.2132883949475712 / (299)) + (0.03230291004856035 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6926566899951863 = (21.356956998043984 - 6.563917855409309) / 21.356956998043984 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.524035610138527 < 20.16768026703084. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 54.4712547769892 (T) = (0 -6.829131892086184) / Math.Sqrt((0.8277234275151538 / (299)) + (2.2988232125926693 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6790823473867986 = (21.280013226063524 - 6.829131892086184) / 21.280013226063524 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.121574185963349 < 13.707420842302357. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 153.82142383202734 (T) = (0 -5.992618716577232) / Math.Sqrt((0.1372938234318162 / (299)) + (0.08541699955773775 / (33))) is greater than 1.9671786747533526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (33) - 2, .975) and 0.5862679946766294 = (14.484300560439925 - 5.992618716577232) / 14.484300560439925 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 5.754246438321486 < 15.195658393897395. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 163.99266143722943 (T) = (0 -5.7038743477796885) / Math.Sqrt((1.0981200344365352 / (299)) + (0.013611708658819326 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6472531121439462 = (16.16987858474681 - 5.7038743477796885) / 16.16987858474681 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.420781571254569 < 19.191081794696856. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 96.18772851368081 (T) = (0 -7.139350843790243) / Math.Sqrt((0.6864263017609012 / (299)) + (0.5570750153413615 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6480632948887532 = (20.28589442392348 - 7.139350843790243) / 20.28589442392348 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.LocalAddress.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.035945504299593 < 18.79117377241098. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 195.2049605819061 (T) = (0 -6.043094578224408) / Math.Sqrt((1.07851178734515 / (299)) + (0.04663129355477612 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6950482535255615 = (19.81655999051952 - 6.043094578224408) / 19.81655999051952 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline c7537bdf261a7160836447ec46e1f136580a9fe4
Compare 27f781f9e3441c6b501e1f090989238ffea97596
Diff Diff

Improvements in StoreBlock.AnyLocation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[CopyBlock16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock16.html>) 22.70 ns 7.84 ns 0.35 0.05 False
[InitBlockAllOnes16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes16.html>) 18.79 ns 6.68 ns 0.36 0.07 False
[CopyBlock64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock64.html>) 25.11 ns 8.87 ns 0.35 0.13 False
[InitBlockAllOnes32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes32.html>) 20.86 ns 6.83 ns 0.33 0.13 False
[InitBlockAllOnes128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes128.html>) 24.01 ns 7.58 ns 0.32 0.10 False
[InitBlockAllOnes8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes8.html>) 17.48 ns 6.56 ns 0.38 0.09 False
[InitBlockAllZeros8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros8.html>) 17.30 ns 6.58 ns 0.38 0.07 False
[InitBlockAllOnes64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllOnes64.html>) 22.33 ns 6.91 ns 0.31 0.05 False
[InitBlockAllZeros64 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros64.html>) 22.39 ns 6.95 ns 0.31 0.07 False
[CopyBlock128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock128.html>) 28.64 ns 10.34 ns 0.36 0.11 False
[InitBlockAllZeros16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros16.html>) 18.66 ns 6.69 ns 0.36 0.08 False
[CopyBlock32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock32.html>) 25.51 ns 8.26 ns 0.32 0.04 False
[InitBlockAllZeros32 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros32.html>) 20.90 ns 6.73 ns 0.32 0.08 False
[InitBlockAllZeros128 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.InitBlockAllZeros128.html>) 28.82 ns 7.65 ns 0.27 0.08 False
[CopyBlock8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_CompliationMode=wasm_RunKind=micro/StoreBlock.AnyLocation.CopyBlock8.html>) 22.02 ns 7.78 ns 0.35 0.05 False

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.AnyLocation*'
### Payloads [Baseline]() [Compare]() ### Histogram #### StoreBlock.AnyLocation.CopyBlock16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.838421258145481 < 21.586686054174766. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 208.46919644174008 (T) = (0 -8.023309985302506) / Math.Sqrt((0.5074609845851428 / (299)) + (0.09331327224680926 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.633922444805059 = (21.916967788505882 - 8.023309985302506) / 21.916967788505882 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.684632869128041 < 17.86029022135419. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 49.16271902077607 (T) = (0 -6.95434468931164) / Math.Sqrt((0.36315451619849987 / (299)) + (1.9704473458275102 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6322983230729022 = (18.913007815002267 - 6.95434468931164) / 18.913007815002267 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.86728615473812 < 23.883617782165732. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 237.55018989504453 (T) = (0 -8.54461536736043) / Math.Sqrt((0.49023683514786465 / (299)) + (0.11171226656630757 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6611418401979003 = (25.215905594100693 - 8.54461536736043) / 25.215905594100693 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.830288255846052 < 19.831656461563394. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 144.62725054357693 (T) = (0 -6.8099118084143395) / Math.Sqrt((2.103471017129498 / (299)) + (0.09403989890103528 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6776821104432278 = (21.12793620539905 - 6.8099118084143395) / 21.12793620539905 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.582789936050581 < 22.860247011334785. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 61.62458031315096 (T) = (0 -8.085018942461707) / Math.Sqrt((0.45656232543350583 / (299)) + (2.2487782018026063 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6647363696305382 = (24.11540713065711 - 8.085018942461707) / 24.11540713065711 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.56071288548933 < 16.241035663463908. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 304.4548589186084 (T) = (0 -6.659428161481272) / Math.Sqrt((0.22234007571502293 / (299)) + (0.014936698030582797 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6112590074481181 = (17.13075875473178 - 6.659428161481272) / 17.13075875473178 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.5831002957982685 < 16.434484537443364. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 170.9810274694291 (T) = (0 -6.690255298134327) / Math.Sqrt((0.16813029249605538 / (299)) + (0.10412408991048032 / (33))) is greater than 1.9671786747533526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (33) - 2, .975) and 0.6091069654390899 = (17.11530957733613 - 6.690255298134327) / 17.11530957733613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllOnes64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.907540949342834 < 21.196847760538102. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 461.3811741466292 (T) = (0 -6.8957567763833865) / Math.Sqrt((0.3098700664421216 / (299)) + (0.0028054754896001165 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6911710339633597 = (22.328724098908697 - 6.8957567763833865) / 22.328724098908697 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros64 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.946919809756634 < 21.254646967018555. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 283.46701737200203 (T) = (0 -6.959116345391187) / Math.Sqrt((0.22712133855605632 / (299)) + (0.07371221728979371 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6878868857973395 = (22.29677648492691 - 6.959116345391187) / 22.29677648492691 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 10.33880830932738 < 27.289326110374933. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 202.6932799120931 (T) = (0 -10.64033261552155) / Math.Sqrt((0.6238761377489513 / (299)) + (0.2054493887576536 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6320203633855807 = (28.915547374896786 - 10.64033261552155) / 28.915547374896786 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros16 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.687859339654228 < 17.749838674857337. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 421.0918010162362 (T) = (0 -6.724281301626736) / Math.Sqrt((0.15872563651652027 / (299)) + (0.010016012561208869 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6427525169376599 = (18.82247355246822 - 6.724281301626736) / 18.82247355246822 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 8.262249784180973 < 23.31716727424822. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 256.3211519729611 (T) = (0 -8.352430703500328) / Math.Sqrt((0.6055035390844158 / (299)) + (0.05471787631520324 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6491327044235264 = (23.805098989854034 - 8.352430703500328) / 23.805098989854034 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros32 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 6.729278246862687 < 19.863249867079674. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 334.270628515412 (T) = (0 -6.755326418646752) / Math.Sqrt((0.5388391074994223 / (299)) + (0.0010466895311873972 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6793307344975447 = (21.066335771411897 - 6.755326418646752) / 21.066335771411897 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.InitBlockAllZeros128 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.6539762696916 < 22.94701582333953. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 257.51643775970473 (T) = (0 -7.767945140074026) / Math.Sqrt((0.2999165711717889 / (299)) + (0.10428946968854633 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.678976290536046 = (24.197418792041734 - 7.767945140074026) / 24.197418792041734 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ```#### StoreBlock.AnyLocation.CopyBlock8 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed:Marked as improvement because 7.777944713774183 < 20.92979886391466. IsChangePoint: Marked as a change because one of 3/6/2023 4:48:38 PM, 3/14/2023 10:43:28 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 10:43:28 AM. IsImprovementStdDev: Marked as improvement because 221.23115308710183 (T) = (0 -7.959927348811732) / Math.Sqrt((0.6607783714650934 / (299)) + (0.044208249336182316 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.6221649731658832 = (21.067203365204215 - 7.959927348811732) / 21.067203365204215 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
radekdoulik commented 1 year ago

@kg looks like https://github.com/dotnet/runtime/pull/83033 :-)