search

dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Windows/x86: 21 Improvements on 4/17/2023 1:30:24 AM #16949

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ProducerConsumer - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).ProducerConsumer(RentalSize%3a%204096%2c%20ManipulateArray%3a%20True%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) 12.78 μs 1.56 μs 0.12 0.42 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.55782285 < 12.096824160833334. IsChangePoint: Marked as a change because one of 4/7/2023 7:53:47 AM, 4/11/2023 5:52:15 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 6.0404157582095666 (T) = (0 -1612.8974895176468) / Math.Sqrt((9590945.734402208 / (299)) + (8961.649378239505 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.40236749352621076 = (2698.8115138418843 - 1612.8974895176468) / 2698.8115138418843 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_baseline_9f63ed9a-ac32-4743-aa53-90021dd3031f.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_compare_9f63ed9a-ac32-4743-aa53-90021dd3031f.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_baseline_9f63ed9a-ac32-4743-aa53-90021dd3031f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Tests_RentReturnArrayPoolTests_Byte__ProducerConsumer_RentalSize__4096__ManipulateArr_compare_9f63ed9a-ac32-4743-aa53-90021dd3031f.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Globalization.Tests.Perf_DateTimeCultureInfo

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20).html>) 327.94 ns 251.37 ns 0.77 0.01 True 2766.8806626880987 2163.0113489443174 0.7817508641095109) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20ja).html>) 328.60 ns 254.36 ns 0.77 0.01 True 2757.052952265989 2132.4848340342496 0.7734653163921229) Trace Trace
[ToStringHebrewIsrael - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael.html>) 499.87 ns 455.79 ns 0.91 0.00 True 4048.0501369012914 3712.62530513116 0.9171391607251947) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20fr).html>) 326.42 ns 251.69 ns 0.77 0.01 True Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20da).html>) 296.73 ns 235.35 ns 0.79 0.00 True 2478.6454820584513 2056.1324347515883 0.8295387338103807) Trace Trace

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_DateTimeCultureInfo*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 251.3678368984552 < 311.1157379116402. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 54.910488993288205 (T) = (0 -254.31360556241864) / Math.Sqrt((56.663741890063065 / (299)) + (19.70631747323278 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.1550342670919282 = (300.9750521919529 - 254.31360556241864) / 300.9750521919529 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____baseline_8f387047-e9cf-44b0-975d-7669a705cb4c.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____compare_8f387047-e9cf-44b0-975d-7669a705cb4c.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____baseline_8f387047-e9cf-44b0-975d-7669a705cb4c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring____compare_8f387047-e9cf-44b0-975d-7669a705cb4c.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ja) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 254.35671404919037 < 311.50004718702303. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 65.57355294521459 (T) = (0 -250.70753880897277) / Math.Sqrt((64.26593013441563 / (299)) + (10.989044484772457 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.1587046797889226 = (298.0018226489972 - 250.70753880897277) / 298.0018226489972 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__baseline_b66065e8-197c-4b24-b788-fb348c67c89b.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__compare_b66065e8-197c-4b24-b788-fb348c67c89b.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__baseline_b66065e8-197c-4b24-b788-fb348c67c89b.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__ja__compare_b66065e8-197c-4b24-b788-fb348c67c89b.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 455.78721668995325 < 474.6784871113136. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 60.23683082993271 (T) = (0 -459.1676533613338) / Math.Sqrt((19.49780236802217 / (299)) + (6.305669157727027 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.05986844850704854 = (488.4078750810613 - 459.1676533613338) / 488.4078750810613 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_baseline_5ee394fd-3155-42c9-ab63-c7efa46866e2.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_compare_5ee394fd-3155-42c9-ab63-c7efa46866e2.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_baseline_5ee394fd-3155-42c9-ab63-c7efa46866e2.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToStringHebrewIsrael_compare_5ee394fd-3155-42c9-ab63-c7efa46866e2.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: fr) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 251.6938206266876 < 311.3225161492201. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 55.605062943637805 (T) = (0 -254.26036997814265) / Math.Sqrt((56.3656416123238 / (299)) + (18.194550372641128 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.15281050132353605 = (300.1221927034804 - 254.26036997814265) / 300.1221927034804 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__baseline_84d523b8-cad5-4ae3-b0a0-0c8577ff6f7d.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__compare_84d523b8-cad5-4ae3-b0a0-0c8577ff6f7d.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__baseline_84d523b8-cad5-4ae3-b0a0-0c8577ff6f7d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__fr__compare_84d523b8-cad5-4ae3-b0a0-0c8577ff6f7d.log) #### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: da) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 235.34757073278396 < 282.102924921146. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 59.087106912107856 (T) = (0 -238.55628013368928) / Math.Sqrt((8.587243360454387 / (299)) + (29.32781114640157 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.1833240067181176 = (292.10639482009316 - 238.55628013368928) / 292.10639482009316 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__baseline_0aa18531-fc24-4e6f-8118-9205da2eb9ec.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__compare_0aa18531-fc24-4e6f-8118-9205da2eb9ec.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__baseline_0aa18531-fc24-4e6f-8118-9205da2eb9ec.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Globalization_Tests_Perf_DateTimeCultureInfo_ToString_culturestring__da__compare_0aa18531-fc24-4e6f-8118-9205da2eb9ec.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%2018446744073709551615).html>) 68.52 ns 50.62 ns 0.74 0.01 True Trace Trace
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%204294967295).html>) 74.77 ns 14.63 ns 0.20 0.06 False Trace Trace
[FormatterInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value%3a%209223372036854775807).html>) 67.20 ns 49.91 ns 0.74 0.01 True 509.6526577525869 367.2231241537256 0.7205360721026509) Trace Trace
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%202147483647).html>) 19.72 ns 8.58 ns 0.44 0.07 True 230.8071512162151 115.56108199209739 0.5006824155281147) Trace Trace

graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 18446744073709551615) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 50.616239244291584 < 65.25068217075267. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 103.5203189502767 (T) = (0 -53.62161636921127) / Math.Sqrt((1.1439285194003936 / (299)) + (0.2919852062117198 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.17285497288327048 = (64.827345400511 - 53.62161636921127) / 64.827345400511 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__baseline_e1cf3c53-834a-4ed7-9e35-22b2a87f4ae9.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__compare_e1cf3c53-834a-4ed7-9e35-22b2a87f4ae9.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__baseline_e1cf3c53-834a-4ed7-9e35-22b2a87f4ae9.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__18446744073709551615__compare_e1cf3c53-834a-4ed7-9e35-22b2a87f4ae9.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 4294967295) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.62678470057168 < 71.0313415782647. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 6.099333319779278 (T) = (0 -15.495044173828813) / Math.Sqrt((180.0322332337118 / (299)) + (0.0408785667997 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.2341403894144264 = (20.2322252794887 - 15.495044173828813) / 20.2322252794887 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__baseline_8262c1d2-59bf-42a4-9dc9-1a367491941e.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__compare_8262c1d2-59bf-42a4-9dc9-1a367491941e.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__baseline_8262c1d2-59bf-42a4-9dc9-1a367491941e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__4294967295__compare_8262c1d2-59bf-42a4-9dc9-1a367491941e.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 49.91306837516972 < 63.92381809929988. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 76.88794465970072 (T) = (0 -53.82061044826285) / Math.Sqrt((0.7696639632785475 / (299)) + (0.5863869449946395 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.16241053937581204 = (64.25655166214088 - 53.82061044826285) / 64.25655166214088 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__baseline_1ed0532e-2cd4-4d8b-a318-2a6c1faeba90.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__compare_1ed0532e-2cd4-4d8b-a318-2a6c1faeba90.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__baseline_1ed0532e-2cd4-4d8b-a318-2a6c1faeba90.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt64_value__9223372036854775807__compare_1ed0532e-2cd4-4d8b-a318-2a6c1faeba90.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.578749636402728 < 18.71710760363691. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 21.043821026779014 (T) = (0 -16.683634554099513) / Math.Sqrt((0.6839990316184374 / (299)) + (1.9138718402532515 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.226693195030862 = (21.574405458342426 - 16.683634554099513) / 21.574405458342426 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__baseline_beeb153b-2345-4a34-9081-6e919d1c0d78.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__compare_beeb153b-2345-4a34-9081-6e919d1c0d78.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__baseline_beeb153b-2345-4a34-9081-6e919d1c0d78.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__2147483647__compare_beeb153b-2345-4a34-9081-6e919d1c0d78.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_UInt64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.TryFormat(value%3a%200).html>) 12.26 ns 7.82 ns 0.64 0.46 False 75.60377451901165 79.40461440863787 1.0502731499029911) Trace Trace
[ParseSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.ParseSpan(value%3a%20%2218446744073709551615%22).html>) 95.56 ns 1.99 ns 0.02 0.20 True Trace Trace

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.TryFormat(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.8191934948190935 < 11.662022041289562. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 58.15846196140545 (T) = (0 -7.846546119245324) / Math.Sqrt((1.2660152046810291 / (299)) + (0.00038474079099138416 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.32564249138784934 = (11.635587976759934 - 7.846546119245324) / 11.635587976759934 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_UInt64_TryFormat_value__0__baseline_0264086b-c087-4ef8-91f0-5be32b708e58.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_UInt64_TryFormat_value__0__compare_0264086b-c087-4ef8-91f0-5be32b708e58.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__0__baseline_0264086b-c087-4ef8-91f0-5be32b708e58.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__0__compare_0264086b-c087-4ef8-91f0-5be32b708e58.log) #### System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.993510950271417 < 90.62138669962363. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 12.456502762341648 (T) = (0 -19.88259458011908) / Math.Sqrt((37.396439918984825 / (299)) + (1354.5652798665665 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.7937886775564873 = (96.41853970247193 - 19.88259458011908) / 96.41853970247193 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_UInt64_ParseSpan_value___18446744073709551615___baseline_b5bc9a7b-ba35-402d-af56-7c618430209a.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_UInt64_ParseSpan_value___18446744073709551615___compare_b5bc9a7b-ba35-402d-af56-7c618430209a.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_UInt64_ParseSpan_value___18446744073709551615___baseline_b5bc9a7b-ba35-402d-af56-7c618430209a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_UInt64_ParseSpan_value___18446744073709551615___compare_b5bc9a7b-ba35-402d-af56-7c618430209a.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22(%5bA-Za-z%5dawyer%7c%5bA-Za-z%5dinn)%5c%5cs%22%2c%20Options%3a%20None).html>) 1.44 secs 1.18 secs 0.82 0.11 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "([A-Za-z]awyer|[A-Za-z]inn)\\s", Options: None) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.1792205214285714 < 1.3649868438333332. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 3/25/2023 10:49:06 AM, 4/10/2023 1:33:42 PM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 17.768447463449764 (T) = (0 -1187667782.3294728) / Math.Sqrt((7865005499042027 / (299)) + (303616868812430.1 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.08078752922105689 = (1292049248.769482 - 1187667782.3294728) / 1292049248.769482 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[DivideBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Numerics.Tests.Perf_VectorOf(Int64).DivideBenchmark.html>) 24.78 ns 21.08 ns 0.85 0.06 False Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Numerics.Tests.Perf_VectorOf<Int64>.DivideBenchmark ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 21.079291234492583 < 23.64568747427802. IsChangePoint: Marked as a change because one of 2/6/2023 9:02:07 PM, 2/28/2023 10:21:25 PM, 3/20/2023 8:31:51 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 33.700589183351084 (T) = (0 -21.32741167584328) / Math.Sqrt((2.8472663580020923 / (299)) + (0.04453649438282937 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.1406374879348917 = (24.817712404735943 - 21.32741167584328) / 24.817712404735943 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_baseline_a3b49100-ac6a-4ce9-a3dc-b6eef5d20f00.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_compare_a3b49100-ac6a-4ce9-a3dc-b6eef5d20f00.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_baseline_a3b49100-ac6a-4ce9-a3dc-b6eef5d20f00.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Numerics_Tests_Perf_VectorOf_Int64__DivideBenchmark_compare_a3b49100-ac6a-4ce9-a3dc-b6eef5d20f00.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_DateTimeOffset

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22G%22).html>) 371.49 ns 303.89 ns 0.82 0.03 False 3136.169860229833 2636.217909115022 0.8405851808427965) Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTimeOffset.ToString(format%3a%20%22s%22).html>) 338.76 ns 88.88 ns 0.26 0.01 True 2843.2612153744403 571.4258110051398 0.2009754882580799) Trace Trace

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTimeOffset.ToString(format: "G") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 303.8900778143279 < 353.6016942818885. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 28.56551601714094 (T) = (0 -308.5977804608429) / Math.Sqrt((66.49960208150429 / (299)) + (50.54106444140232 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.10447327829188532 = (344.59918724951945 - 308.5977804608429) / 344.59918724951945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTimeOffset_ToString_format___G___baseline_6b30ff15-986a-4882-b2cb-19711d845629.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTimeOffset_ToString_format___G___compare_6b30ff15-986a-4882-b2cb-19711d845629.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___G___baseline_6b30ff15-986a-4882-b2cb-19711d845629.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___G___compare_6b30ff15-986a-4882-b2cb-19711d845629.log) #### System.Tests.Perf_DateTimeOffset.ToString(format: "s") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 88.8765256026168 < 324.04839926990314. IsChangePoint: Marked as a change because one of 4/19/2023 8:38:27 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 450.4249515767395 (T) = (0 -89.03183558065298) / Math.Sqrt((88.47669133818148 / (299)) + (0.05950725573795321 / (23))) is greater than 1.9674049737480528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (23) - 2, .975) and 0.734328908919888 = (335.1205252279624 - 89.03183558065298) / 335.1205252279624 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTimeOffset_ToString_format___s___baseline_c127e282-2d66-4123-82bc-ade2edfe5ada.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTimeOffset_ToString_format___s___compare_c127e282-2d66-4123-82bc-ade2edfe5ada.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___s___baseline_c127e282-2d66-4123-82bc-ade2edfe5ada.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTimeOffset_ToString_format___s___compare_c127e282-2d66-4123-82bc-ade2edfe5ada.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTime.ToString(format%3a%20null).html>) 358.17 ns 295.24 ns 0.82 0.01 False Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTime.ToString(format%3a%20%22s%22).html>) 326.51 ns 76.69 ns 0.23 0.01 True Trace Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_DateTime.ToString(format%3a%20%22G%22).html>) 357.58 ns 288.22 ns 0.81 0.02 False 3023.4300513952967 2530.5074916288686 0.8369657801281207) Trace Trace

graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_DateTime.ToString(format: null) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 295.24123037220426 < 341.110697081942. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 35.532527565639 (T) = (0 -295.01342732253084) / Math.Sqrt((61.37137984071002 / (299)) + (36.844477078066575 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.1166057141198315 = (333.95442107551634 - 295.01342732253084) / 333.95442107551634 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format__null__baseline_20820fe7-dfec-44f1-8746-b80aad42e559.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format__null__compare_20820fe7-dfec-44f1-8746-b80aad42e559.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format__null__baseline_20820fe7-dfec-44f1-8746-b80aad42e559.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format__null__compare_20820fe7-dfec-44f1-8746-b80aad42e559.log) #### System.Tests.Perf_DateTime.ToString(format: "s") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 76.68926613087245 < 310.91678346827496. IsChangePoint: Marked as a change because one of 4/19/2023 8:38:27 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 420.0033151184039 (T) = (0 -76.78219843553856) / Math.Sqrt((98.90417445702884 / (299)) + (0.25549285718060616 / (23))) is greater than 1.9674049737480528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (23) - 2, .975) and 0.7618155283941842 = (322.36441745291245 - 76.78219843553856) / 322.36441745291245 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format___s___baseline_7b2060cf-54aa-4287-8bf5-c1d02e870150.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format___s___compare_7b2060cf-54aa-4287-8bf5-c1d02e870150.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format___s___baseline_7b2060cf-54aa-4287-8bf5-c1d02e870150.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format___s___compare_7b2060cf-54aa-4287-8bf5-c1d02e870150.log) #### System.Tests.Perf_DateTime.ToString(format: "G") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 288.21970401359226 < 339.7082065734739. IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 25.332856008720352 (T) = (0 -294.82184194717877) / Math.Sqrt((60.77614668269057 / (299)) + (75.48199569204252 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.11402299221570818 = (332.7646647224945 - 294.82184194717877) / 332.7646647224945 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format___G___baseline_84a5b9d8-218e-4831-aa7a-656394389d14.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Tests_Perf_DateTime_ToString_format___G___compare_84a5b9d8-218e-4831-aa7a-656394389d14.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format___G___baseline_84a5b9d8-218e-4831-aa7a-656394389d14.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Tests_Perf_DateTime_ToString_format___G___compare_84a5b9d8-218e-4831-aa7a-656394389d14.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.IO.Tests.Perf_StreamWriter

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[WriteFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.IO.Tests.Perf_StreamWriter.WriteFormat.html>) 100.50 ns 89.37 ns 0.89 0.07 False Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.IO.Tests.Perf_StreamWriter.WriteFormat ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 89.37444099617117 < 95.82895686767003. IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 26.10242970818721 (T) = (0 -90.38983653211152) / Math.Sqrt((7.703907588388126 / (299)) + (0.7440229584387853 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.05824820459980606 = (95.9805300861685 - 90.38983653211152) / 95.9805300861685 is greater than 0.05. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_IO_Tests_Perf_StreamWriter_WriteFormat_baseline_96638cf8-0628-46d2-8ceb-3af4457fecc7.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_IO_Tests_Perf_StreamWriter_WriteFormat_compare_96638cf8-0628-46d2-8ceb-3af4457fecc7.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_IO_Tests_Perf_StreamWriter_WriteFormat_baseline_96638cf8-0628-46d2-8ceb-3af4457fecc7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_IO_Tests_Perf_StreamWriter_WriteFormat_compare_96638cf8-0628-46d2-8ceb-3af4457fecc7.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[SliceTenSegments - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Tests.ReadOnlySequenceTests(Char).SliceTenSegments.html>) 36.12 ns 25.46 ns 0.70 0.03 True Trace Trace

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'
### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceTenSegments ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 25.464966946251725 < 34.444797837659515. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/25/2023 3:46:39 AM falls between 4/12/2023 8:39:35 PM and 4/25/2023 3:46:39 AM. IsImprovementStdDev: Marked as improvement because 62.07541495324898 (T) = (0 -25.73366170189441) / Math.Sqrt((0.17102729487504995 / (299)) + (1.0926339750990468 / (37))) is greater than 1.9670919629190173 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (37) - 2, .975) and 0.2950418931819356 = (36.50381696870925 - 25.73366170189441) / 36.50381696870925 is greater than 0.05. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### JIT Disasms [Baseline](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Tests_ReadOnlySequenceTests_Char__SliceTenSegments_baseline_d4042e1b-a296-4434-8419-bd44e48b004d.log) [Compare](https://pvscmdupload.z22.web.core.windows.net/autofilereport/jitdasms/04_25_2023/System_Buffers_Tests_ReadOnlySequenceTests_Char__SliceTenSegments_compare_d4042e1b-a296-4434-8419-bd44e48b004d.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Tests_ReadOnlySequenceTests_Char__SliceTenSegments_baseline_d4042e1b-a296-4434-8419-bd44e48b004d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F04_25_2023%2FSystem_Buffers_Tests_ReadOnlySequenceTests_Char__SliceTenSegments_compare_d4042e1b-a296-4434-8419-bd44e48b004d.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)