search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Windows/x86: 22 Improvements on 4/17/2023 1:30:24 AM #16355

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Globalization.Tests.Perf_DateTimeCultureInfo

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20da).html>) 311.17 ns 246.36 ns 0.79 0.00 True 2477.907071526415 2099.682841454795 0.8473614146318125) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20).html>) 330.95 ns 260.86 ns 0.79 0.01 False 2769.9942323261675 2208.4276482843075 0.7972679590851454) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20ja).html>) 330.48 ns 255.28 ns 0.77 0.01 False Trace Trace
[ToStringHebrewIsrael - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael.html>) 507.63 ns 463.07 ns 0.91 0.00 False Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20fr).html>) 329.83 ns 260.15 ns 0.79 0.01 False 2773.1655994670436 2207.9660965985167 0.7961897756927503) Trace Trace

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_DateTimeCultureInfo*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: da) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 246.36283483480784 < 277.0090741929574. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 18.802649725840798 (T) = (0 -247.4768741952379) / Math.Sqrt((8.587243360454387 / (299)) + (22.420575125175187 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.15278515436932608 = (292.10639482009316 - 247.4768741952379) / 292.10639482009316 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__baseline_a07145cc-0369-4339-9f50-8bd0fcf7806c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__compare_a07145cc-0369-4339-9f50-8bd0fcf7806c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__baseline_a07145cc-0369-4339-9f50-8bd0fcf7806c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__compare_a07145cc-0369-4339-9f50-8bd0fcf7806c.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 260.860733590277 < 286.4285849701217. IsChangePoint: Marked as a change because one of 2/23/2023 8:54:44 PM, 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 72.67147275585391 (T) = (0 -260.19913850610135) / Math.Sqrt((56.663741890063065 / (299)) + (0.5012864017384463 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.1354793807290243 = (300.9750521919529 - 260.19913850610135) / 300.9750521919529 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____baseline_fb70d284-617c-4070-bd36-3be8d79c3cd5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____compare_fb70d284-617c-4070-bd36-3be8d79c3cd5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____baseline_fb70d284-617c-4070-bd36-3be8d79c3cd5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____compare_fb70d284-617c-4070-bd36-3be8d79c3cd5.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ja) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 255.27816842975483 < 279.6075978943875. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 70.75679390859842 (T) = (0 -255.5050623131905) / Math.Sqrt((64.26593013441563 / (299)) + (0.5831521678262631 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.142605706092817 = (298.0018226489972 - 255.5050623131905) / 298.0018226489972 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__baseline_56266ba9-0ff0-4377-a607-d1ace65d0470.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__compare_56266ba9-0ff0-4377-a607-d1ace65d0470.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__baseline_56266ba9-0ff0-4377-a607-d1ace65d0470.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__compare_56266ba9-0ff0-4377-a607-d1ace65d0470.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 463.07325908284474 < 465.7540808870126. IsChangePoint: Marked as a change because one of 2/17/2023 5:12:50 PM, 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 57.925721704514544 (T) = (0 -463.40148260313856) / Math.Sqrt((19.49780236802217 / (299)) + (0.48461095328420484 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.051199814240858496 = (488.4078750810613 - 463.40148260313856) / 488.4078750810613 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_baseline_35af4460-a6ff-44b1-8f1d-9a091eaa1383.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_compare_35af4460-a6ff-44b1-8f1d-9a091eaa1383.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_baseline_35af4460-a6ff-44b1-8f1d-9a091eaa1383.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_compare_35af4460-a6ff-44b1-8f1d-9a091eaa1383.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: fr) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 260.1453005729233 < 281.6682056329602. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 88.21374046138983 (T) = (0 -260.21612951972077) / Math.Sqrt((56.3656416123238 / (299)) + (0.06453243187107245 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.13296605234117645 = (300.1221927034804 - 260.21612951972077) / 300.1221927034804 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__baseline_93a3d527-f06c-42a0-ad39-a98cab86c9db.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__compare_93a3d527-f06c-42a0-ad39-a98cab86c9db.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__baseline_93a3d527-f06c-42a0-ad39-a98cab86c9db.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__compare_93a3d527-f06c-42a0-ad39-a98cab86c9db.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FirstWithPredicate_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input%3a%20Array).html>) 740.06 ns 642.82 ns 0.87 0.02 False Trace Trace
[ElementAt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.ElementAt(input%3a%20IEnumerable).html>) 189.38 ns 172.21 ns 0.91 0.12 False Trace Trace
[FirstWithPredicate_LastElementMatches - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input%3a%20IEnumerable).html>) 745.83 ns 647.85 ns 0.87 0.01 False Trace Trace

graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: Array) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 642.8215597060226 < 706.0410869253506. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 29.705879451626245 (T) = (0 -644.539922609565) / Math.Sqrt((587.677716275659 / (299)) + (8.130489111818601 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.08437913632569054 = (703.937566497863 - 644.539922609565) / 703.937566497863 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__Array__baseline_b57060d1-56c3-4331-8f32-bd0736ab37fa.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__Array__compare_b57060d1-56c3-4331-8f32-bd0736ab37fa.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__Array__baseline_b57060d1-56c3-4331-8f32-bd0736ab37fa.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__Array__compare_b57060d1-56c3-4331-8f32-bd0736ab37fa.log) #### System.Linq.Tests.Perf_Enumerable.ElementAt(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 172.21499491262006 < 179.97231592905615. IsChangePoint: Marked as a change because one of 3/6/2023 11:14:52 AM, 3/15/2023 8:07:42 AM, 3/25/2023 12:18:49 AM, 4/9/2023 11:04:55 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 3.9149265809113234 (T) = (0 -162.04303794661755) / Math.Sqrt((282.7978515231536 / (299)) + (83.56723862684049 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.056608826703743564 = (171.7665402575593 - 162.04303794661755) / 171.7665402575593 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ElementAt_input__IEnumerable__baseline_1ffc5686-3aff-4ebb-aa04-57a40eac259d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ElementAt_input__IEnumerable__compare_1ffc5686-3aff-4ebb-aa04-57a40eac259d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ElementAt_input__IEnumerable__baseline_1ffc5686-3aff-4ebb-aa04-57a40eac259d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ElementAt_input__IEnumerable__compare_1ffc5686-3aff-4ebb-aa04-57a40eac259d.log) #### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 647.8528242590743 < 706.8166379303631. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/13/2023 6:54:14 PM, 3/6/2023 11:14:52 AM, 3/14/2023 8:42:09 PM, 3/25/2023 3:46:49 AM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 37.40925310165604 (T) = (0 -648.6159372476449) / Math.Sqrt((356.90920890639023 / (299)) + (6.853977800794627 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.08953445719499933 = (712.4003125361137 - 648.6159372476449) / 712.4003125361137 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__baseline_4a64e1dc-439d-4ce6-8f96-44774a73a146.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__compare_4a64e1dc-439d-4ce6-8f96-44774a73a146.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__baseline_4a64e1dc-439d-4ce6-8f96-44774a73a146.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_FirstWithPredicate_LastElementMatches_input__IEnumerable__compare_4a64e1dc-439d-4ce6-8f96-44774a73a146.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTime.ToString(format%3a%20%22s%22).html>) 325.32 ns 280.73 ns 0.86 0.00 False 2734.165092708361 2363.260478932121 0.8643444703593827) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTime.ToString(format%3a%20null).html>) 354.49 ns 308.90 ns 0.87 0.01 False 3035.2956701287007 2553.037688586777 0.8411166377338537) Trace Trace

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTime.ToString(format: "s") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 280.73239765085935 < 305.19387869944535. IsChangePoint: Marked as a change because one of 3/17/2023 1:30:52 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 27.87440379670733 (T) = (0 -283.00102949107827) / Math.Sqrt((17.691670672360694 / (299)) + (8.617719249215414 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.12781342471781104 = (324.47303995652027 - 283.00102949107827) / 324.47303995652027 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTime_ToString_format___s___baseline_66ac4143-361b-47d3-af6f-1b8922944090.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTime_ToString_format___s___compare_66ac4143-361b-47d3-af6f-1b8922944090.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTime_ToString_format___s___baseline_66ac4143-361b-47d3-af6f-1b8922944090.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTime_ToString_format___s___compare_66ac4143-361b-47d3-af6f-1b8922944090.log) #### System.Tests.Perf_DateTime.ToString(format: null) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 308.9003975381286 < 316.4901446767879. IsChangePoint: Marked as a change because one of 3/16/2023 8:14:39 PM, 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 14.77134696321801 (T) = (0 -303.41873585060256) / Math.Sqrt((61.37137984071002 / (299)) + (16.272641002524008 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.09143668506190794 = (333.95442107551634 - 303.41873585060256) / 333.95442107551634 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTime_ToString_format__null__baseline_ec79ed67-857e-4fc7-83f5-fb5bbbd39921.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTime_ToString_format__null__compare_ec79ed67-857e-4fc7-83f5-fb5bbbd39921.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTime_ToString_format__null__baseline_ec79ed67-857e-4fc7-83f5-fb5bbbd39921.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTime_ToString_format__null__compare_ec79ed67-857e-4fc7-83f5-fb5bbbd39921.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%204294967295).html>) 74.76 ns 15.34 ns 0.21 0.06 False 392.428612922288 134.40155225264775 0.34248662769975713) Trace Trace
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%202147483647).html>) 19.63 ns 17.22 ns 0.88 0.07 False Trace Trace
[FormatterDouble - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value%3a%2012345).html>) 214.04 ns 201.98 ns 0.94 0.00 False Trace Trace
[FormatterInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value%3a%209223372036854775807).html>) 67.28 ns 53.55 ns 0.80 0.01 False Trace Trace
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%2018446744073709551615).html>) 68.44 ns 53.62 ns 0.78 0.01 False 516.8967407708561 404.95042687964747 0.7834261564035762) Trace Trace

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 4294967295) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 15.336401480505113 < 16.022090682129683. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 6.231755227790576 (T) = (0 -15.393712515120427) / Math.Sqrt((180.0322332337118 / (299)) + (0.0029072919485871027 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.2391488181615655 = (20.2322252794887 - 15.393712515120427) / 20.2322252794887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__baseline_964b117c-2a36-4746-982b-265cee7361bf.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__compare_964b117c-2a36-4746-982b-265cee7361bf.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__baseline_964b117c-2a36-4746-982b-265cee7361bf.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__compare_964b117c-2a36-4746-982b-265cee7361bf.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 17.21552115290864 < 20.583376820126418. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 38.388580100342615 (T) = (0 -16.937968987034164) / Math.Sqrt((0.6839990316184374 / (299)) + (0.04919731594513973 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.21490448393864947 = (21.574405458342426 - 16.937968987034164) / 21.574405458342426 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__baseline_338bcfbf-4e9a-48a0-85c8-0e1a659110b5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__compare_338bcfbf-4e9a-48a0-85c8-0e1a659110b5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__baseline_338bcfbf-4e9a-48a0-85c8-0e1a659110b5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__compare_338bcfbf-4e9a-48a0-85c8-0e1a659110b5.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 201.9828182631659 < 203.2352592539591. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 52.75043208949699 (T) = (0 -202.35456553395898) / Math.Sqrt((2.1235491175834955 / (299)) + (0.20075800877132674 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.05873165262253591 = (214.9807396559692 - 202.35456553395898) / 214.9807396559692 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDouble_value__12345__baseline_184b1149-39bc-4a68-9a60-8889fc1b00b9.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDouble_value__12345__compare_184b1149-39bc-4a68-9a60-8889fc1b00b9.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDouble_value__12345__baseline_184b1149-39bc-4a68-9a60-8889fc1b00b9.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDouble_value__12345__compare_184b1149-39bc-4a68-9a60-8889fc1b00b9.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 53.55196354533364 < 60.65564272434044. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 49.63700420891523 (T) = (0 -54.09922467142782) / Math.Sqrt((0.7696639632785475 / (299)) + (0.15720076267876484 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.15807457337766886 = (64.25655166214088 - 54.09922467142782) / 64.25655166214088 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__baseline_ecd55f8f-d02f-4808-b344-1bb811be073a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__compare_ecd55f8f-d02f-4808-b344-1bb811be073a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__baseline_ecd55f8f-d02f-4808-b344-1bb811be073a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__compare_ecd55f8f-d02f-4808-b344-1bb811be073a.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 18446744073709551615) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 53.621256448690396 < 61.52713519022491. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 71.6162678453892 (T) = (0 -53.665424254926535) / Math.Sqrt((1.1439285194003936 / (299)) + (0.0818626525744977 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.17217921043388099 = (64.827345400511 - 53.665424254926535) / 64.827345400511 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__baseline_7727dc8f-a4d7-4a5a-ad81-a16b8be22bc1.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__compare_7727dc8f-a4d7-4a5a-ad81-a16b8be22bc1.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__baseline_7727dc8f-a4d7-4a5a-ad81-a16b8be22bc1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__compare_7727dc8f-a4d7-4a5a-ad81-a16b8be22bc1.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int64).DivideBenchmark.html>) 26.24 ns 21.26 ns 0.81 0.06 False Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 21.26148867045658 < 24.910194024946414. IsChangePoint: Marked as a change because one of 2/4/2023 4:58:40 AM, 2/6/2023 9:02:07 PM, 2/28/2023 10:21:25 PM, 3/20/2023 8:31:51 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 35.62011719587886 (T) = (0 -21.28371834119013) / Math.Sqrt((2.8472663580020923 / (299)) + (0.0012827002566857676 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.14239805852820758 = (24.817712404735943 - 21.28371834119013) / 24.817712404735943 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_baseline_1b1308e1-b0e0-4feb-95fe-b94ce7e474b6.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_compare_1b1308e1-b0e0-4feb-95fe-b94ce7e474b6.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_baseline_1b1308e1-b0e0-4feb-95fe-b94ce7e474b6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_compare_1b1308e1-b0e0-4feb-95fe-b94ce7e474b6.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_DateTimeOffset

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22G%22).html>) 370.31 ns 312.40 ns 0.84 0.02 False 3133.0812761903903 2654.556612253134 0.8472670761611684) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22s%22).html>) 337.50 ns 297.33 ns 0.88 0.00 False 2839.593055432191 2472.0000445548767 0.8705472919177266) Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTimeOffset.ToString(format: "G") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 312.4025646314644 < 324.0103900723417. IsChangePoint: Marked as a change because one of 3/15/2023 5:33:41 AM, 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 43.33791098598133 (T) = (0 -311.31469949321246) / Math.Sqrt((66.49960208150429 / (299)) + (1.4698070352837627 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.09658899088524592 = (344.59918724951945 - 311.31469949321246) / 344.59918724951945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTimeOffset_ToString_format___G___baseline_dd8e4c30-a714-40a7-b7f2-e1a09fdde562.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTimeOffset_ToString_format___G___compare_dd8e4c30-a714-40a7-b7f2-e1a09fdde562.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___G___baseline_dd8e4c30-a714-40a7-b7f2-e1a09fdde562.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___G___compare_dd8e4c30-a714-40a7-b7f2-e1a09fdde562.log) #### System.Tests.Perf_DateTimeOffset.ToString(format: "s") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 297.32521958654064 < 319.1363742683701. IsChangePoint: Marked as a change because one of 3/15/2023 5:33:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 81.92861516898142 (T) = (0 -296.03160421002536) / Math.Sqrt((14.941849735046622 / (299)) + (0.8006473161078932 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.12158601788172957 = (337.0069354954409 - 296.03160421002536) / 337.0069354954409 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTimeOffset_ToString_format___s___baseline_9b003a43-2231-431b-838b-a17cd4679d8c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_DateTimeOffset_ToString_format___s___compare_9b003a43-2231-431b-838b-a17cd4679d8c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___s___baseline_9b003a43-2231-431b-838b-a17cd4679d8c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___s___compare_9b003a43-2231-431b-838b-a17cd4679d8c.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_UInt64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.TryFormat(value%3a%200).html>) 12.11 ns 7.86 ns 0.65 0.51 False Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.TryFormat(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.860648119422943 < 11.355046413036114. IsChangePoint: Marked as a change because one of 2/7/2023 8:22:47 AM, 3/25/2023 12:18:49 AM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 57.243423264314664 (T) = (0 -7.867442349888889) / Math.Sqrt((1.2660152046810291 / (299)) + (0.00039595926040560223 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.3238466018560696 = (11.635587976759934 - 7.867442349888889) / 11.635587976759934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__0__baseline_57a2da49-e9f7-46fe-92e0-1dda63269f3f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__0__compare_57a2da49-e9f7-46fe-92e0-1dda63269f3f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__0__baseline_57a2da49-e9f7-46fe-92e0-1dda63269f3f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__0__compare_57a2da49-e9f7-46fe-92e0-1dda63269f3f.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DotBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(UInt64).DotBenchmark.html>) 9.37 ns 0.57 ns 0.06 0.11 True

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DotBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 0.574850165488863 < 8.91821579106993. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 72.20100260270861 (T) = (0 -0.21752471862334932) / Math.Sqrt((0.4688237212467605 / (299)) + (0.06101561288003746 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.9772984561852684 = (9.581935061270743 - 0.21752471862334932) / 9.581935061270743 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.IO.Tests.Perf_StreamWriter

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.IO.Tests.Perf_StreamWriter.WriteFormat.html>) 97.26 ns 89.70 ns 0.92 0.07 False Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_StreamWriter.WriteFormat ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 89.70327099580408 < 93.3498645299971. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 21.677276004663337 (T) = (0 -89.97951848322175) / Math.Sqrt((7.703907588388126 / (299)) + (0.2034864130095905 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.06252321796471863 = (95.9805300861685 - 89.97951848322175) / 95.9805300861685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_IO_Tests_Perf_StreamWriter_WriteFormat_baseline_935af1e9-bf9f-4db1-9e00-5260b10e7c78.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_IO_Tests_Perf_StreamWriter_WriteFormat_compare_935af1e9-bf9f-4db1-9e00-5260b10e7c78.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_IO_Tests_Perf_StreamWriter_WriteFormat_baseline_935af1e9-bf9f-4db1-9e00-5260b10e7c78.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_IO_Tests_Perf_StreamWriter_WriteFormat_compare_935af1e9-bf9f-4db1-9e00-5260b10e7c78.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 12.78 μs 1.58 μs 0.12 0.41 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.5807170999999995 < 1.6613960129166667. IsChangePoint: Marked as a change because one of 4/7/2023 7:53:47 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsImprovementStdDev: Marked as improvement because 6.337563426055939 (T) = (0 -1560.0899068498452) / Math.Sqrt((9590945.734402208 / (299)) + (829.9692810570735 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.4219344704703055 = (2698.8115138418843 - 1560.0899068498452) / 2698.8115138418843 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_baseline_cfdb9323-5310-4d5b-913a-a6bafc5c32a9.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_compare_cfdb9323-5310-4d5b-913a-a6bafc5c32a9.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_baseline_cfdb9323-5310-4d5b-913a-a6bafc5c32a9.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_compare_cfdb9323-5310-4d5b-913a-a6bafc5c32a9.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)