[Perf] Windows/x86: 108 Regressions on 4/17/2023 1:30:24 AM

graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_Enumerable.ToDictionary(input: List) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.9638879440665156 > 1.3196423615122967. IsChangePoint: Marked as a change because one of 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/17/2023 9:25:32 PM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -74.70945375572565 (T) = (0 -1964.0924325529345) / Math.Sqrt((2772.4805119940143 / (32)) + (8.64065473651785 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.5565906972444655 = (1261.7911927842326 - 1964.0924325529345) / 1261.7911927842326 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__List__baseline_2c48c0b1-7366-405a-9eab-016bbde71239.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__List__compare_2c48c0b1-7366-405a-9eab-016bbde71239.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__List__baseline_2c48c0b1-7366-405a-9eab-016bbde71239.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__List__compare_2c48c0b1-7366-405a-9eab-016bbde71239.log) #### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 309.23261124474277 > 295.420232901797. IsChangePoint: Marked as a change because one of 2/13/2023 6:54:14 PM, 2/14/2023 5:47:38 PM, 2/20/2023 10:31:48 AM, 2/23/2023 8:54:44 PM, 4/8/2023 3:09:32 AM, 4/9/2023 11:04:55 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -4.867735485497324 (T) = (0 -310.0491663416671) / Math.Sqrt((212.2337150454982 / (20)) + (1.5786572548142255 / (17))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (17) - 2, .025) and -0.05414796546259579 = (294.1230040752458 - 310.0491663416671) / 294.1230040752458 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_SelectToArray_input__Array__baseline_231e6f0e-56a6-4365-a9f3-56365d2a5b3f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_SelectToArray_input__Array__compare_231e6f0e-56a6-4365-a9f3-56365d2a5b3f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_SelectToArray_input__Array__baseline_231e6f0e-56a6-4365-a9f3-56365d2a5b3f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_SelectToArray_input__Array__compare_231e6f0e-56a6-4365-a9f3-56365d2a5b3f.log) #### System.Linq.Tests.Perf_Enumerable.Aggregate(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 708.3667429214037 > 663.3467595742234. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/17/2023 10:06:19 AM, 4/9/2023 11:04:55 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -11.993932881894542 (T) = (0 -689.5787107725073) / Math.Sqrt((51.64739251267893 / (20)) + (260.9256143187261 / (17))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (17) - 2, .025) and -0.07950686865244892 = (638.7904799839857 - 689.5787107725073) / 638.7904799839857 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_Aggregate_input__IEnumerable__baseline_3eeb9890-7c3b-4367-bcee-b945e74fa2ee.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_Aggregate_input__IEnumerable__compare_3eeb9890-7c3b-4367-bcee-b945e74fa2ee.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_Aggregate_input__IEnumerable__baseline_3eeb9890-7c3b-4367-bcee-b945e74fa2ee.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_Aggregate_input__IEnumerable__compare_3eeb9890-7c3b-4367-bcee-b945e74fa2ee.log) #### System.Linq.Tests.Perf_Enumerable.WhereSelect(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.459404077019021 > 1.4036677060228482. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -33.05766875581418 (T) = (0 -1462.1433889476245) / Math.Sqrt((208.79448148335462 / (32)) + (19.3984847781159 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.0786646908126998 = (1355.51242327771 - 1462.1433889476245) / 1355.51242327771 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_WhereSelect_input__IEnumerable__baseline_44bf2e0f-90f3-482f-823f-908d0a7e8010.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_WhereSelect_input__IEnumerable__compare_44bf2e0f-90f3-482f-823f-908d0a7e8010.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_WhereSelect_input__IEnumerable__baseline_44bf2e0f-90f3-482f-823f-908d0a7e8010.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_WhereSelect_input__IEnumerable__compare_44bf2e0f-90f3-482f-823f-908d0a7e8010.log) #### System.Linq.Tests.Perf_Enumerable.Reverse(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.2930946903755285 > 1.2714661531303866. IsChangePoint: Marked as a change because one of 2/23/2023 8:54:44 PM, 3/6/2023 11:14:52 AM, 3/22/2023 7:51:01 PM, 4/8/2023 3:09:32 AM, 4/9/2023 11:04:55 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -4.90917188436501 (T) = (0 -1328.9295397758106) / Math.Sqrt((2981.480814154642 / (20)) + (832.5938848202401 / (17))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (17) - 2, .025) and -0.05483773789200576 = (1259.8426203745341 - 1328.9295397758106) / 1259.8426203745341 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__baseline_7baf09a7-5af6-4820-89f5-e563ec8409df.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__compare_7baf09a7-5af6-4820-89f5-e563ec8409df.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__baseline_7baf09a7-5af6-4820-89f5-e563ec8409df.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_Reverse_input__IEnumerable__compare_7baf09a7-5af6-4820-89f5-e563ec8409df.log) #### System.Linq.Tests.Perf_Enumerable.GroupBy(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.1157180096644526 > 3.0452360437895956. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -67.32169687995454 (T) = (0 -3117.9923119631944) / Math.Sqrt((98.2212506724941 / (32)) + (35.634884285759654 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07405049260268758 = (2903.0220957373567 - 3117.9923119631944) / 2903.0220957373567 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_GroupBy_input__IEnumerable__baseline_566cdd95-6f32-4d80-a7d3-327e5eea8cf5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_GroupBy_input__IEnumerable__compare_566cdd95-6f32-4d80-a7d3-327e5eea8cf5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_GroupBy_input__IEnumerable__baseline_566cdd95-6f32-4d80-a7d3-327e5eea8cf5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_GroupBy_input__IEnumerable__compare_566cdd95-6f32-4d80-a7d3-327e5eea8cf5.log) #### System.Linq.Tests.Perf_Enumerable.ToDictionary(input: Array) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.4519605634020938 > 1.2248528247041337. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -143.73991595008226 (T) = (0 -1445.2313214136825) / Math.Sqrt((6.214926168356216 / (32)) + (17.67919163691183 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.23775679992357643 = (1167.6213950130723 - 1445.2313214136825) / 1167.6213950130723 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__Array__baseline_0be0f080-5d2d-497f-8689-bffbdbdd0330.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__Array__compare_0be0f080-5d2d-497f-8689-bffbdbdd0330.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__Array__baseline_0be0f080-5d2d-497f-8689-bffbdbdd0330.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__Array__compare_0be0f080-5d2d-497f-8689-bffbdbdd0330.log) #### System.Linq.Tests.Perf_Enumerable.ToDictionary(input: IEnumerable) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.462482072891254 > 2.7503763242415316. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -104.13006527746617 (T) = (0 -3484.164661270914) / Math.Sqrt((277.1744566923831 / (32)) + (306.0407245028259 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.33300846318024513 = (2613.7603454958685 - 3484.164661270914) / 2613.7603454958685 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__IEnumerable__baseline_db1ff997-7695-4925-8761-fbb234c01ec7.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Linq_Tests_Perf_Enumerable_ToDictionary_input__IEnumerable__compare_db1ff997-7695-4925-8761-fbb234c01ec7.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__IEnumerable__baseline_db1ff997-7695-4925-8761-fbb234c01ec7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Linq_Tests_Perf_Enumerable_ToDictionary_input__IEnumerable__compare_db1ff997-7695-4925-8761-fbb234c01ec7.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<StructRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToStream(Mode%3a%20SourceGen).html>)	414.13 ns	445.37 ns	1.08	0.05	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToUtf8Bytes(Mode%3a%20Reflection).html>)	477.59 ns	516.98 ns	1.08	0.08	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	338.02 ns	386.07 ns	1.14	0.04	False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeObjectProperty(Mode%3a%20Reflection).html>)	735.00 ns	791.26 ns	1.08	0.03	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToString(Mode%3a%20Reflection).html>)	518.15 ns	567.99 ns	1.10	0.10	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToString(Mode%3a%20SourceGen).html>)	384.07 ns	423.51 ns	1.10	0.04	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToWriter(Mode%3a%20Reflection).html>)	413.40 ns	446.89 ns	1.08	0.10	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToWriter(Mode%3a%20SourceGen).html>)	271.86 ns	302.19 ns	1.11	0.01	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(StructRecord).SerializeToStream(Mode%3a%20Reflection).html>)	561.68 ns	642.41 ns	1.14	0.09	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;StructRecord&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToStream(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 445.3661934504197 > 434.54482712542153. IsChangePoint: Marked as a change because one of 2/24/2023 6:56:27 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -7.1258220948686395 (T) = (0 -451.5951702936387) / Math.Sqrt((39.68973839542706 / (32)) + (114.71006243950339 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.0841226737115655 = (416.5535702224296 - 451.5951702936387) / 416.5535702224296 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToUtf8Bytes(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 516.9840625104686 > 503.070660310828. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -14.609385428344543 (T) = (0 -520.7109369358366) / Math.Sqrt((51.253053772238985 / (32)) + (27.13651466995942 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.08036187473781185 = (481.97826035114906 - 520.7109369358366) / 481.97826035114906 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 386.071654040404 > 359.96051915788115. IsChangePoint: Marked as a change because one of 3/17/2023 9:25:32 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -12.285072924595838 (T) = (0 -387.16961447977326) / Math.Sqrt((54.13594215629438 / (32)) + (32.53135896735764 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.09993003014028458 = (351.9947668220258 - 387.16961447977326) / 351.9947668220258 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeObjectProperty(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 791.2599862609405 > 776.4967982918597. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -6.838710995518719 (T) = (0 -804.5520369150424) / Math.Sqrt((105.05621395903036 / (32)) + (420.18800363347367 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.08628218688116006 = (740.6473627492715 - 804.5520369150424) / 740.6473627492715 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToString(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 567.9939887524667 > 546.5781450918429. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -9.077644763628978 (T) = (0 -572.0526883925837) / Math.Sqrt((133.01365207143675 / (32)) + (90.81260218760835 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.0810437859043703 = (529.1669919863799 - 572.0526883925837) / 529.1669919863799 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 423.5108396505456 > 408.64563892839385. IsChangePoint: Marked as a change because one of 3/21/2023 3:33:39 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -7.30333527701231 (T) = (0 -431.68120436822875) / Math.Sqrt((82.05977153873037 / (32)) + (127.99635822192803 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.0986412053875507 = (392.9228234398429 - 431.68120436822875) / 392.9228234398429 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 446.88750456897714 > 424.88733498087896. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -25.90556438737974 (T) = (0 -447.9110880808832) / Math.Sqrt((12.37220765973141 / (32)) + (12.889455437112657 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.11059467386875481 = (403.3074339539065 - 447.9110880808832) / 403.3074339539065 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 302.19105448419356 > 285.72582412669686. IsChangePoint: Marked as a change because one of 3/21/2023 3:33:39 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -38.269152305447705 (T) = (0 -300.87536839026086) / Math.Sqrt((12.780938978861597 / (32)) + (2.291535264325649 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.13352545787220357 = (265.4332695403673 - 300.87536839026086) / 265.4332695403673 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToStream(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 642.4144679518598 > 602.6689773938274. IsChangePoint: Marked as a change because one of 3/28/2023 6:01:18 PM, 3/30/2023 11:40:48 AM, 4/12/2023 4:44:56 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -13.965477071510755 (T) = (0 -631.8061134657871) / Math.Sqrt((157.41093804300996 / (31)) + (58.062157111149304 / (6))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (6) - 2, .025) and -0.0927839598837163 = (578.1619575867658 - 631.8061134657871) / 578.1619575867658 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	2.13 ms	3.17 ms	1.49	0.00	True				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	778.54 ns	889.83 ns	1.14	0.01	True	7564.674321371115	8403.951928803139	1.110946958425026)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	1.26 μs	1.35 μs	1.07	0.01	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	1.18 μs	1.30 μs	1.10	0.03	False	11131.745289185645	11926.734518096644	1.0714164049085206)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	920.13 ns	1.03 μs	1.12	0.06	False				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	3.09 ms	3.97 ms	1.29	0.00	True				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	1.05 μs	1.16 μs	1.11	0.01	False				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	2.13 ms	3.16 ms	1.48	0.00	True	19490804.59770115	26893162.393162396	1.3797871841747527)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	3.15 ms	4.03 ms	1.28	0.00	True	29848101.265822783	36724590.163934425	1.230382791751832)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	826.85 ns	936.78 ns	1.13	0.02	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	2.22 ms	3.21 ms	1.44	0.00	True	20501190.476190478	27877922.07792208	1.359819670486879)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	1.07 μs	1.20 μs	1.12	0.01	False	10344.938353804191	11173.08168794068	1.0800529984629585)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	968.99 ns	1.07 μs	1.11	0.06	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	3.05 ms	3.94 ms	1.29	0.00	True	28830452.674897116	35722580.64516129	1.2390572235539403)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	2.23 ms	3.23 ms	1.45	0.00	True	20497297.2972973	27877922.07792208	1.3600779494766837)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	3.13 ms	4.02 ms	1.28	0.00	True	29835443.03797468	36735519.125683054	1.2312711119766488)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.167870886075949 > 2.2191954622926096. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -276.38424173823955 (T) = (0 -3168470.6170735033) / Math.Sqrt((292931761.68163294 / (31)) + (25270122.37470463 / (5))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (5) - 2, .025) and -0.4974533314027663 = (2115906.0857712217 - 3168470.6170735033) / 2115906.0857712217 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_8b085e50-02b9-4ef2-9ad0-abd38606e38c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_8b085e50-02b9-4ef2-9ad0-abd38606e38c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_8b085e50-02b9-4ef2-9ad0-abd38606e38c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_8b085e50-02b9-4ef2-9ad0-abd38606e38c.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 889.8335172370388 > 814.9914860845493. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -38.42238786258809 (T) = (0 -898.523078230431) / Math.Sqrt((56.64152354775122 / (32)) + (42.997931935978855 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.15969043530841043 = (774.7956272412266 - 898.523078230431) / 774.7956272412266 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_d58db82b-0f9f-4e4a-8371-e133b7932178.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_d58db82b-0f9f-4e4a-8371-e133b7932178.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_d58db82b-0f9f-4e4a-8371-e133b7932178.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_d58db82b-0f9f-4e4a-8371-e133b7932178.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.3492810695635855 > 1.3009967544403709. IsChangePoint: Marked as a change because one of 2/6/2023 2:52:08 AM, 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -30.78256292167177 (T) = (0 -1353.2130865269467) / Math.Sqrt((332.6576384524108 / (32)) + (50.09565264613721 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.11455422046862879 = (1214.1294354957183 - 1353.2130865269467) / 1214.1294354957183 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_64720ca5-464a-4452-9454-e2c67228bdd3.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_64720ca5-464a-4452-9454-e2c67228bdd3.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_64720ca5-464a-4452-9454-e2c67228bdd3.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_64720ca5-464a-4452-9454-e2c67228bdd3.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.3001205456330667 > 1.245001859564333. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -50.702919868203715 (T) = (0 -1303.1475514344006) / Math.Sqrt((150.63043849648946 / (32)) + (6.948542409570562 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.10628210463857037 = (1177.9523016510761 - 1303.1475514344006) / 1177.9523016510761 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_dee28649-3c98-4a64-86a4-cd0564e69441.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_dee28649-3c98-4a64-86a4-cd0564e69441.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_dee28649-3c98-4a64-86a4-cd0564e69441.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_dee28649-3c98-4a64-86a4-cd0564e69441.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0272972503761515 > 969.0743947584506. IsChangePoint: Marked as a change because one of 2/9/2023 10:24:28 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -20.235082026455576 (T) = (0 -1033.8167565717592) / Math.Sqrt((103.21491802663158 / (32)) + (140.81670832761245 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.12316661277924533 = (920.4482619133485 - 1033.8167565717592) / 920.4482619133485 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_fd8385ed-34d8-447c-872c-8dd00d3ec907.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_fd8385ed-34d8-447c-872c-8dd00d3ec907.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_fd8385ed-34d8-447c-872c-8dd00d3ec907.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_fd8385ed-34d8-447c-872c-8dd00d3ec907.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.9716665608465607 > 3.239373696581197. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -77.91995049271809 (T) = (0 -3957447.0687830686) / Math.Sqrt((3638444987.904759 / (32)) + (127472382.63990544 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.3025899235228194 = (3038137.3272720086 - 3957447.0687830686) / 3038137.3272720086 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_1ab7b351-d4c4-4c30-8050-8fd6c1d81b48.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_1ab7b351-d4c4-4c30-8050-8fd6c1d81b48.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_1ab7b351-d4c4-4c30-8050-8fd6c1d81b48.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_1ab7b351-d4c4-4c30-8050-8fd6c1d81b48.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.1613024677931172 > 1.0947112727678034. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -32.52891886059978 (T) = (0 -1155.7354837586756) / Math.Sqrt((217.593424405254 / (32)) + (30.675327580832306 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.11262674815535592 = (1038.7450110064228 - 1155.7354837586756) / 1038.7450110064228 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_16566b40-8760-470b-9950-61d990829381.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_16566b40-8760-470b-9950-61d990829381.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_16566b40-8760-470b-9950-61d990829381.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_16566b40-8760-470b-9950-61d990829381.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.15543444846293 > 2.23567429661017. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -189.2208771437746 (T) = (0 -3167449.8770343577) / Math.Sqrt((206559207.52752882 / (32)) + (122139446.94538084 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.49697173529691463 = (2115904.9315023404 - 3167449.8770343577) / 2115904.9315023404 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_d545ecb1-b663-4bec-bae7-b416544a4a2e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_d545ecb1-b663-4bec-bae7-b416544a4a2e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_d545ecb1-b663-4bec-bae7-b416544a4a2e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_d545ecb1-b663-4bec-bae7-b416544a4a2e.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.032473763440861 > 3.298129382832278. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -110.72119534649583 (T) = (0 -4027066.415455512) / Math.Sqrt((958692044.1946833 / (32)) + (196163529.81735605 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.2965152363512352 = (3106069.487304159 - 4027066.415455512) / 3106069.487304159 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_3b59c7cc-b3d7-4d89-b08e-1460afeecb19.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_3b59c7cc-b3d7-4d89-b08e-1460afeecb19.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_3b59c7cc-b3d7-4d89-b08e-1460afeecb19.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_3b59c7cc-b3d7-4d89-b08e-1460afeecb19.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 936.7836590336891 > 867.4186341561101. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -42.71609610917973 (T) = (0 -942.3629957200395) / Math.Sqrt((102.97168371211386 / (31)) + (17.747279056035268 / (5))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (5) - 2, .025) and -0.13484108679852586 = (830.3920316971587 - 942.3629957200395) / 830.3920316971587 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_a05dc7f2-b583-4be2-a8ab-6ce766a6095f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_a05dc7f2-b583-4be2-a8ab-6ce766a6095f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_a05dc7f2-b583-4be2-a8ab-6ce766a6095f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_a05dc7f2-b583-4be2-a8ab-6ce766a6095f.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.2114453846153848 > 2.3250039424778763. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -120.29299473115661 (T) = (0 -3221397.2227113545) / Math.Sqrt((458657506.1028266 / (32)) + (282762413.7619611 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.45856459294897556 = (2208607.8589075194 - 3221397.2227113545) / 2208607.8589075194 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_4e80540a-791e-48e1-9a70-21fdcbbdcc6d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_4e80540a-791e-48e1-9a70-21fdcbbdcc6d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_4e80540a-791e-48e1-9a70-21fdcbbdcc6d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_4e80540a-791e-48e1-9a70-21fdcbbdcc6d.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.1978520046038752 > 1.1300415987598653. IsChangePoint: Marked as a change because one of 2/8/2023 7:09:09 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -30.569568362927953 (T) = (0 -1210.5735376507357) / Math.Sqrt((95.72738470157442 / (32)) + (69.15955708598415 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1155422849948358 = (1085.1883912731644 - 1210.5735376507357) / 1085.1883912731644 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_a4ff9a29-77c0-4cc8-8abe-0e7c6ccd3a2d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_a4ff9a29-77c0-4cc8-8abe-0e7c6ccd3a2d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_a4ff9a29-77c0-4cc8-8abe-0e7c6ccd3a2d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_a4ff9a29-77c0-4cc8-8abe-0e7c6ccd3a2d.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0709703607462262 > 1016.9509447720881. IsChangePoint: Marked as a change because one of 2/6/2023 2:52:08 AM, 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -7.443913688371195 (T) = (0 -1081.6749950118244) / Math.Sqrt((481.10441496289627 / (31)) + (942.2554429627563 / (5))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (5) - 2, .025) and -0.10899815141685142 = (975.3623066277261 - 1081.6749950118244) / 975.3623066277261 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_97e85580-cddc-40bf-8c3e-f91190107c73.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_97e85580-cddc-40bf-8c3e-f91190107c73.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_97e85580-cddc-40bf-8c3e-f91190107c73.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_97e85580-cddc-40bf-8c3e-f91190107c73.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.943230612244898 > 3.201512420731708. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -121.85490631931205 (T) = (0 -3951700.2714111293) / Math.Sqrt((1314120763.304579 / (32)) + (87799364.04142717 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.30907998382007285 = (3018685.1225694646 - 3951700.2714111293) / 3018685.1225694646 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_6c3627b6-7ed6-494e-87c9-d982f874db3f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_6c3627b6-7ed6-494e-87c9-d982f874db3f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_6c3627b6-7ed6-494e-87c9-d982f874db3f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_6c3627b6-7ed6-494e-87c9-d982f874db3f.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.2280610389610382 > 2.335024124150601. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -161.07924787880708 (T) = (0 -3234888.861075432) / Math.Sqrt((196894313.68052778 / (32)) + (173968220.45457792 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4676352494023598 = (2204150.4266081923 - 3234888.861075432) / 2204150.4266081923 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_3d87aadd-2e2e-4676-b199-5a3be0313eff.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_3d87aadd-2e2e-4676-b199-5a3be0313eff.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_3d87aadd-2e2e-4676-b199-5a3be0313eff.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_3d87aadd-2e2e-4676-b199-5a3be0313eff.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.0189866359447 > 3.2794699875. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -129.5271706465301 (T) = (0 -4020734.2874867073) / Math.Sqrt((1421037962.9819694 / (32)) + (28394316.75827792 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.2953192873334477 = (3104048.806193426 - 4020734.2874867073) / 3104048.806193426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_7aabad7f-9c45-4fcc-90f4-93e7ee8aeefb.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_7aabad7f-9c45-4fcc-90f4-93e7ee8aeefb.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_7aabad7f-9c45-4fcc-90f4-93e7ee8aeefb.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_7aabad7f-9c45-4fcc-90f4-93e7ee8aeefb.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Tests.DictionarySequentialKeys

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ContainsKey_3k_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue.html>)	6.26 ns	9.07 ns	1.45	0.09	True	59.604234088457396	90.57294840544384	1.5195723892874191)	Trace	Trace
[TryGetValue_17_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue.html>)	6.40 ns	9.59 ns	1.50	0.00	True	60.1515994582734	91.23026753291333	1.516672347111882)	Trace	Trace
[ContainsKey_3k_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue.html>)	6.50 ns	9.70 ns	1.49	0.23	True				Trace	Trace
[TryGetValue_17_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int.html>)	6.30 ns	9.25 ns	1.47	0.07	True				Trace	Trace
[TryGetValue_3k_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue.html>)	6.28 ns	8.75 ns	1.39	0.08	True	59.52248516720604	90.53341216842885	1.5209951653414548)	Trace	Trace
[ContainsKey_17_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue.html>)	6.34 ns	9.57 ns	1.51	0.01	True	60.27538460338762	90.7799947992417	1.5060873588210941)	Trace	Trace
[ContainsValue_17_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int.html>)	6.40 ns	9.26 ns	1.45	0.09	True	60.159681492197656	91.35283625237042	1.5185059825195106)	Trace	Trace
[ContainsValue_3k_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int.html>)	6.27 ns	8.68 ns	1.38	0.04	True				Trace	Trace
[TryGetValue_17_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue.html>)	6.38 ns	9.59 ns	1.50	0.01	True	60.15933694195446	90.88466195271661	1.510732441090697)	Trace	Trace
[TryGetValue_3k_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int.html>)	6.24 ns	8.44 ns	1.35	0.02	True	59.48148148148148	90.66320014595878	1.524225656252109)	Trace	Trace
[TryGetValue_3k_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue.html>)	6.53 ns	9.69 ns	1.48	0.26	True				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.DictionarySequentialKeys*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.069958572013093 > 6.621385055558496. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -20.082954333819444 (T) = (0 -8.769070248576696) / Math.Sqrt((0.014551675293417323 / (32)) + (0.06653361985910033 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.36735696122289874 = (6.413153622104691 - 8.769070248576696) / 6.413153622104691 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_baseline_f9b28799-6ce3-4641-81b6-1f06fde8f3cd.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_compare_f9b28799-6ce3-4641-81b6-1f06fde8f3cd.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_baseline_f9b28799-6ce3-4641-81b6-1f06fde8f3cd.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_compare_f9b28799-6ce3-4641-81b6-1f06fde8f3cd.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.589125992812052 > 6.700049962105608. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -58.02717414997088 (T) = (0 -9.468870897723564) / Math.Sqrt((0.0019745878561024965 / (32)) + (0.014173204569132826 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4921051926620295 = (6.345980795650457 - 9.468870897723564) / 6.345980795650457 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_baseline_a3b05c33-a51a-438c-822c-845a00b31110.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_compare_a3b05c33-a51a-438c-822c-845a00b31110.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_baseline_a3b05c33-a51a-438c-822c-845a00b31110.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_compare_a3b05c33-a51a-438c-822c-845a00b31110.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.69513424204874 > 6.676331814045899. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -11.872512047689684 (T) = (0 -9.079229185312121) / Math.Sqrt((0.029428923091578883 / (32)) + (0.23720610412800777 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.403642937751368 = (6.468332466273097 - 9.079229185312121) / 6.468332466273097 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_baseline_dcfaac50-14b8-42b9-a345-802c5ee39156.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_compare_dcfaac50-14b8-42b9-a345-802c5ee39156.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_baseline_dcfaac50-14b8-42b9-a345-802c5ee39156.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_compare_dcfaac50-14b8-42b9-a345-802c5ee39156.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.252316584176755 > 6.743120047405091. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -112.18094391273507 (T) = (0 -9.245984422637273) / Math.Sqrt((0.02080399191051322 / (32)) + (2.1312794269046504E-05 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4500583807559282 = (6.376284255408572 - 9.245984422637273) / 6.376284255408572 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_baseline_3c6db466-16fc-4228-88ea-afce3ed56f20.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_compare_3c6db466-16fc-4228-88ea-afce3ed56f20.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_baseline_3c6db466-16fc-4228-88ea-afce3ed56f20.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_compare_3c6db466-16fc-4228-88ea-afce3ed56f20.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.751701326774 > 6.639930977571016. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -18.61304815311919 (T) = (0 -8.976348054316357) / Math.Sqrt((0.014774931544529505 / (32)) + (0.09383253335012774 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4035733879170229 = (6.3953535537160136 - 8.976348054316357) / 6.3953535537160136 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_baseline_d666d9da-5ebc-435c-9162-3352c3d29490.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_compare_d666d9da-5ebc-435c-9162-3352c3d29490.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_baseline_d666d9da-5ebc-435c-9162-3352c3d29490.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_compare_d666d9da-5ebc-435c-9162-3352c3d29490.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.57396093344107 > 6.606140174044635. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -29.714292003109176 (T) = (0 -9.659575429485823) / Math.Sqrt((0.0020747494861119726 / (32)) + (0.061791177513422633 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.52175492237492 = (6.347655123343153 - 9.659575429485823) / 6.347655123343153 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_baseline_6c507c65-f43a-473c-8d44-ae4810fd2afa.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_compare_6c507c65-f43a-473c-8d44-ae4810fd2afa.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_baseline_6c507c65-f43a-473c-8d44-ae4810fd2afa.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_compare_6c507c65-f43a-473c-8d44-ae4810fd2afa.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.26401467328262 > 6.718105708628436. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -51.29348161899658 (T) = (0 -9.249927015586772) / Math.Sqrt((0.09613841513037984 / (32)) + (0.00023623645836010797 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.44160212014985967 = (6.4164216230656 - 9.249927015586772) / 6.4164216230656 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_baseline_9951233f-877e-4bb1-a166-4ef043554756.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_compare_9951233f-877e-4bb1-a166-4ef043554756.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_baseline_9951233f-877e-4bb1-a166-4ef043554756.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_compare_9951233f-877e-4bb1-a166-4ef043554756.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.677574372759857 > 6.559512902821456. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -42.14757974962445 (T) = (0 -8.627034808090508) / Math.Sqrt((0.0006312665505013887 / (32)) + (0.015738218571777592 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.37922344074641284 = (6.254994334653782 - 8.627034808090508) / 6.254994334653782 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_baseline_16558ea6-d40a-43f1-aec8-005df81343d1.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_compare_16558ea6-d40a-43f1-aec8-005df81343d1.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_baseline_16558ea6-d40a-43f1-aec8-005df81343d1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_compare_16558ea6-d40a-43f1-aec8-005df81343d1.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.591760951144726 > 6.696748568806835. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -66.16685926118073 (T) = (0 -9.472263212592352) / Math.Sqrt((0.0010550000640043098 / (32)) + (0.011037116860782478 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.49395315092289854 = (6.340401776816632 - 9.472263212592352) / 6.340401776816632 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_baseline_8dff3f1c-edab-4c3c-bff4-820ddc40a21f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_compare_8dff3f1c-edab-4c3c-bff4-820ddc40a21f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_baseline_8dff3f1c-edab-4c3c-bff4-820ddc40a21f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_compare_8dff3f1c-edab-4c3c-bff4-820ddc40a21f.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.439583092541225 > 6.5555447230538935. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -13.772400168650991 (T) = (0 -8.597081753227119) / Math.Sqrt((0.001434836116047061 / (32)) + (0.1437286745165584 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.3732895707914083 = (6.260210472779413 - 8.597081753227119) / 6.260210472779413 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_baseline_e61d58c7-0f6c-4c9c-9b66-8710f714c8f5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_compare_e61d58c7-0f6c-4c9c-9b66-8710f714c8f5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_baseline_e61d58c7-0f6c-4c9c-9b66-8710f714c8f5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_compare_e61d58c7-0f6c-4c9c-9b66-8710f714c8f5.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.694397931303671 > 6.892882312802064. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -13.015390107412532 (T) = (0 -9.369639193568343) / Math.Sqrt((0.042157288988185236 / (32)) + (0.23737438994647708 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4426653648535629 = (6.494672584393404 - 9.369639193568343) / 6.494672584393404 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_baseline_d2917daa-4dda-486d-b766-625a4c2f6ed1.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_compare_d2917daa-4dda-486d-b766-625a4c2f6ed1.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_baseline_d2917daa-4dda-486d-b766-625a4c2f6ed1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_compare_d2917daa-4dda-486d-b766-625a4c2f6ed1.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(String%2c%20String).IDictionary(Size%3a%20512).html>)	15.64 μs	20.09 μs	1.28	0.01	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<String, String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.092800572519085 > 16.39875662128713. IsChangePoint: Marked as a change because one of 1/30/2023 9:42:46 PM, 3/14/2023 8:42:09 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -71.31318335087268 (T) = (0 -20238.38925931723) / Math.Sqrt((14664.112554073641 / (32)) + (18549.373513104954 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.2944834707785226 = (15634.335791978516 - 20238.38925931723) / 15634.335791978516 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__baseline_74fa1bd9-3d9a-44e3-9599-c37bdef95901.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__compare_74fa1bd9-3d9a-44e3-9599-c37bdef95901.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__baseline_74fa1bd9-3d9a-44e3-9599-c37bdef95901.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__compare_74fa1bd9-3d9a-44e3-9599-c37bdef95901.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(String%2c%20String).Dictionary(Size%3a%20512).html>)	14.93 μs	19.72 μs	1.32	0.24	False	Trace	Trace
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(String%2c%20String).FrozenDictionary(Size%3a%20512).html>)	16.58 μs	21.03 μs	1.27	0.32	False	Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(String%2c%20String).IDictionary(Size%3a%20512).html>)	17.04 μs	21.33 μs	1.25	0.23	False	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;String, String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryGetValueTrue<String, String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.721898967551624 > 15.82322319931674. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -24.43581072061165 (T) = (0 -19746.892036316985) / Math.Sqrt((843902.3029781427 / (32)) + (20963.53394892792 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.27606434163675947 = (15474.840407332747 - 19746.892036316985) / 15474.840407332747 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__Dictionary_Size__512__baseline_c8dbf23d-345f-4530-9b45-fb03b4d38619.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__Dictionary_Size__512__compare_c8dbf23d-345f-4530-9b45-fb03b4d38619.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__Dictionary_Size__512__baseline_c8dbf23d-345f-4530-9b45-fb03b4d38619.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__Dictionary_Size__512__compare_c8dbf23d-345f-4530-9b45-fb03b4d38619.log) #### System.Collections.TryGetValueTrue<String, String>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.025977576427618 > 17.448393829150554. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -20.07359301219748 (T) = (0 -21133.879220339764) / Math.Sqrt((1134600.7658312018 / (32)) + (17957.419295695585 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.23105894894405546 = (17167.23576760269 - 21133.879220339764) / 17167.23576760269 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__FrozenDictionary_Size__512__baseline_01e66e17-c000-435d-b0d5-694f2eeb75fa.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__FrozenDictionary_Size__512__compare_01e66e17-c000-435d-b0d5-694f2eeb75fa.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__FrozenDictionary_Size__512__baseline_01e66e17-c000-435d-b0d5-694f2eeb75fa.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__FrozenDictionary_Size__512__compare_01e66e17-c000-435d-b0d5-694f2eeb75fa.log) #### System.Collections.TryGetValueTrue<String, String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 21.33459523809524 > 17.84872807077007. IsChangePoint: Marked as a change because one of 1/30/2023 9:42:46 PM, 3/14/2023 8:42:09 PM, 4/12/2023 4:44:56 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -4.293145900300423 (T) = (0 -20042.61636118145) / Math.Sqrt((1126430.0673699 / (31)) + (1918223.6372686946 / (6))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (6) - 2, .025) and -0.14654150647665004 = (17480.933963544765 - 20042.61636118145) / 17480.933963544765 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__IDictionary_Size__512__baseline_32e2ed38-1554-4c4f-b334-ea4afc661cd4.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_String__String__IDictionary_Size__512__compare_32e2ed38-1554-4c4f-b334-ea4afc661cd4.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__IDictionary_Size__512__baseline_32e2ed38-1554-4c4f-b334-ea4afc661cd4.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_String__String__IDictionary_Size__512__compare_32e2ed38-1554-4c4f-b334-ea4afc661cd4.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).FrozenDictionary(Size%3a%20512).html>)	2.97 μs	4.57 μs	1.54	0.01	True	23863.556953179595	40230.33531808211	1.6858482328101465)	Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).Dictionary(Size%3a%20512).html>)	2.94 μs	4.55 μs	1.55	0.01	True	23479.028239202657	39849.624060150374	1.6972433294157347)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<Int32>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.571370406046235 > 3.1209026217852487. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -144.62411973618183 (T) = (0 -4562.192238384584) / Math.Sqrt((130.86857223599785 / (32)) + (587.2513166446913 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.5372398704396639 = (2967.7816234884394 - 4562.192238384584) / 2967.7816234884394 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__baseline_10537b1b-2ec4-4464-ad2f-cb6e9a37d123.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__compare_10537b1b-2ec4-4464-ad2f-cb6e9a37d123.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__baseline_10537b1b-2ec4-4464-ad2f-cb6e9a37d123.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__compare_10537b1b-2ec4-4464-ad2f-cb6e9a37d123.log) #### System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.551176725382615 > 3.08385218788226. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -128.45583470401345 (T) = (0 -4527.575112184902) / Math.Sqrt((162.0705918827283 / (32)) + (744.6440939124439 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.5433966460971187 = (2933.5136393059147 - 4527.575112184902) / 2933.5136393059147 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__Dictionary_Size__512__baseline_f034166b-1cc7-4343-a8e0-4e6817f1e236.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__Dictionary_Size__512__compare_f034166b-1cc7-4343-a8e0-4e6817f1e236.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__Dictionary_Size__512__baseline_f034166b-1cc7-4343-a8e0-4e6817f1e236.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__Dictionary_Size__512__compare_f034166b-1cc7-4343-a8e0-4e6817f1e236.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	6.42 μs	8.57 μs	1.33	0.09	False	35807.51223414267	51502.097009482124	1.4383042494746279)	Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	7.55 μs	8.75 μs	1.16	0.55	False	36801.68776371308	52454.816471026636	1.425337251047158)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.57075345894775 > 6.746868051410159. IsChangePoint: Marked as a change because one of 3/25/2023 10:49:06 AM, 4/10/2023 1:33:42 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -13.080841076696471 (T) = (0 -8660.975001509) / Math.Sqrt((839860.0537244569 / (32)) + (108035.34005924508 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4933984484355232 = (5799.507164737042 - 8660.975001509) / 5799.507164737042 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__baseline_1b8ec67c-2991-4894-a855-3fe82456efbe.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__compare_1b8ec67c-2991-4894-a855-3fe82456efbe.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__baseline_1b8ec67c-2991-4894-a855-3fe82456efbe.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__compare_1b8ec67c-2991-4894-a855-3fe82456efbe.log) #### System.Collections.ContainsKeyFalse<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.751045832666774 > 8.356487258426485. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 4/12/2023 4:47:47 AM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -9.248303688683917 (T) = (0 -8945.358320778134) / Math.Sqrt((252004.91011368882 / (28)) + (50904.22697832914 / (8))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (8) - 2, .025) and -0.1469811015437179 = (7799.045955280873 - 8945.358320778134) / 7799.045955280873 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__IDictionary_Size__512__baseline_02340d27-8b97-4450-be2a-50a29707192e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__IDictionary_Size__512__compare_02340d27-8b97-4450-be2a-50a29707192e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__IDictionary_Size__512__baseline_02340d27-8b97-4450-be2a-50a29707192e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__IDictionary_Size__512__compare_02340d27-8b97-4450-be2a-50a29707192e.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToString(Mode%3a%20SourceGen).html>)	524.35 ns	639.90 ns	1.22	0.02	False	4794.315036617924	5299.290396045104	1.1053279468642108)	Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToWriter(Mode%3a%20Reflection).html>)	750.20 ns	803.66 ns	1.07	0.03	False	5509.9477659114345	5950.989248454575	1.080044585045206)	Trace	Trace
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeObjectProperty(Mode%3a%20Reflection).html>)	1.11 μs	1.20 μs	1.08	0.01	False				Trace	Trace
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeObjectProperty(Mode%3a%20SourceGen).html>)	796.32 ns	885.15 ns	1.11	0.04	False	6574.452184589105	7106.890785967975	1.0809860025489175)	Trace	Trace
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToStream(Mode%3a%20Reflection).html>)	908.91 ns	990.71 ns	1.09	0.01	False	6845.799781915785	7335.6533901691755	1.0715553512896203)	Trace	Trace
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToStream(Mode%3a%20SourceGen).html>)	542.23 ns	642.97 ns	1.19	0.05	False	4926.018881520291	5392.146349832718	1.0946255951354715)	Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToWriter(Mode%3a%20SourceGen).html>)	404.86 ns	482.08 ns	1.19	0.02	True				Trace	Trace
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(LargeStructWithProperties).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	475.94 ns	573.55 ns	1.21	0.05	False	4464.3554306238775	4929.653046091402	1.104225038238611)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;LargeStructWithProperties&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 639.8995015432903 > 546.7227466860942. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -19.6254752482717 (T) = (0 -630.9034795713746) / Math.Sqrt((49.22046731383858 / (32)) + (132.73490459273853 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.19739320302773297 = (526.8974953056938 - 630.9034795713746) / 526.8974953056938 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_baseline_2aa237db-5fc7-4389-8704-c2442e59d637.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_compare_2aa237db-5fc7-4389-8704-c2442e59d637.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_baseline_2aa237db-5fc7-4389-8704-c2442e59d637.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_compare_2aa237db-5fc7-4389-8704-c2442e59d637.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 803.6604363680949 > 789.5863330007701. IsChangePoint: Marked as a change because one of 2/8/2023 3:55:57 PM, 2/21/2023 5:46:41 AM, 3/27/2023 3:21:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -25.555380281817122 (T) = (0 -803.4398352831521) / Math.Sqrt((54.82787175976314 / (32)) + (7.997477882247393 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.061451293681344846 = (756.9257676408753 - 803.4398352831521) / 756.9257676408753 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_baseline_096db2b9-4db3-402c-ac2b-6f84f09898e2.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_compare_096db2b9-4db3-402c-ac2b-6f84f09898e2.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_baseline_096db2b9-4db3-402c-ac2b-6f84f09898e2.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_compare_096db2b9-4db3-402c-ac2b-6f84f09898e2.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.1966846441474583 > 1.1706854723932076. IsChangePoint: Marked as a change because one of 2/15/2023 8:48:29 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -15.490936061154335 (T) = (0 -1196.2207224475992) / Math.Sqrt((228.7922577317471 / (32)) + (94.29296397253977 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07071240037031258 = (1117.2194531733066 - 1196.2207224475992) / 1117.2194531733066 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_567ee006-02e4-42e2-894c-00eed1ad9307.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_567ee006-02e4-42e2-894c-00eed1ad9307.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_567ee006-02e4-42e2-894c-00eed1ad9307.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_567ee006-02e4-42e2-894c-00eed1ad9307.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 885.1537089161833 > 850.7440726911116. IsChangePoint: Marked as a change because one of 3/17/2023 9:25:32 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -11.689176471195285 (T) = (0 -882.5019828100682) / Math.Sqrt((216.063983345506 / (32)) + (179.36603914575707 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.09466339435730332 = (806.185707276894 - 882.5019828100682) / 806.185707276894 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_497c1163-13cc-4443-b679-3d6909758452.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_497c1163-13cc-4443-b679-3d6909758452.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_497c1163-13cc-4443-b679-3d6909758452.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_497c1163-13cc-4443-b679-3d6909758452.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToStream(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 990.7072037754217 > 963.6128265650051. IsChangePoint: Marked as a change because one of 4/5/2023 8:56:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -14.586353495499587 (T) = (0 -983.4900316854284) / Math.Sqrt((85.56910556398887 / (32)) + (79.10889524540768 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.06812986862626257 = (920.7588520582327 - 983.4900316854284) / 920.7588520582327 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_baseline_d608f969-bebc-47fa-950b-7f7549fc84d5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_compare_d608f969-bebc-47fa-950b-7f7549fc84d5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_baseline_d608f969-bebc-47fa-950b-7f7549fc84d5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_compare_d608f969-bebc-47fa-950b-7f7549fc84d5.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToStream(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 642.9741629672656 > 578.4432500090683. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -15.43583256730711 (T) = (0 -636.1874402464898) / Math.Sqrt((71.48721611016107 / (32)) + (135.55408933004665 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.15132409681806225 = (552.5702467313365 - 636.1874402464898) / 552.5702467313365 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_baseline_76e5d5bb-708a-44fc-afb4-62636b94cb0e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_compare_76e5d5bb-708a-44fc-afb4-62636b94cb0e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_baseline_76e5d5bb-708a-44fc-afb4-62636b94cb0e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_compare_76e5d5bb-708a-44fc-afb4-62636b94cb0e.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 482.08137919896643 > 425.4882371820724. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -42.76783355888266 (T) = (0 -480.13866795616934) / Math.Sqrt((66.57352195708349 / (32)) + (5.378540196312966 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.18799313072779789 = (404.15946484641955 - 480.13866795616934) / 404.15946484641955 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_baseline_392417b7-f7d6-442c-b7f2-037e620dbaed.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_compare_392417b7-f7d6-442c-b7f2-037e620dbaed.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_baseline_392417b7-f7d6-442c-b7f2-037e620dbaed.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_compare_392417b7-f7d6-442c-b7f2-037e620dbaed.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 573.5496703202075 > 502.6817146498836. IsChangePoint: Marked as a change because one of 2/20/2023 2:42:44 PM, 3/21/2023 7:06:30 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -15.958745628898086 (T) = (0 -572.9211716257994) / Math.Sqrt((31.62975235796541 / (32)) + (163.1885487664844 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.19264279737727585 = (480.37951756024717 - 572.9211716257994) / 480.37951756024717 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_82e0dfd8-f7d1-4e91-93f7-e0ac35a0f4c6.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_82e0dfd8-f7d1-4e91-93f7-e0ac35a0f4c6.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_82e0dfd8-f7d1-4e91-93f7-e0ac35a0f4c6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_82e0dfd8-f7d1-4e91-93f7-e0ac35a0f4c6.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%204).html>)	1.61 ns	9.93 ns	6.18	0.46	True	31.676500165089628	66.86477305423124	2.110863659361026)	Trace	Trace
[FormatterDecimal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value%3a%20123456.789).html>)	50.98 ns	85.50 ns	1.68	0.02	True	520.2041709647647	794.7513951880765	1.5277682101512944)	Trace	Trace
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%200).html>)	1.60 ns	9.66 ns	6.05	0.08	True				Trace	Trace
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%200).html>)	2.37 ns	14.70 ns	6.21	0.12	True	30.60346438061925	103.91826584360281	3.395637322335729)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.928396043831919 > 1.6917119346486833. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -59.5584434995721 (T) = (0 -10.13208561415235) / Math.Sqrt((0.2720945352782523 / (32)) + (0.04883057964794808 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -3.8665616767802127 = (2.081980315279983 - 10.13208561415235) / 2.081980315279983 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__baseline_7842cd41-4f2d-43f3-b9bf-f0f39e5e57a4.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__compare_7842cd41-4f2d-43f3-b9bf-f0f39e5e57a4.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__baseline_7842cd41-4f2d-43f3-b9bf-f0f39e5e57a4.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__compare_7842cd41-4f2d-43f3-b9bf-f0f39e5e57a4.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.4969970521132 > 52.82228194256532. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -175.78556703604448 (T) = (0 -85.13239747900784) / Math.Sqrt((0.5823869816503896 / (32)) + (0.10900164275653187 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.7034888438142657 = (49.9753184695878 - 85.13239747900784) / 49.9753184695878 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__baseline_f80f6522-3916-467e-8390-0aea2a10b7dc.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__compare_f80f6522-3916-467e-8390-0aea2a10b7dc.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__baseline_f80f6522-3916-467e-8390-0aea2a10b7dc.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__compare_f80f6522-3916-467e-8390-0aea2a10b7dc.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.663919448424382 > 1.677403374385787. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -120.49157047981896 (T) = (0 -9.581010043402225) / Math.Sqrt((0.0026148373478809255 / (32)) + (0.021700011045758045 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -5.10720454581045 = (1.5688045113823492 - 9.581010043402225) / 1.5688045113823492 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__baseline_fc02a284-d30f-47e0-87ae-ddd88c9b9372.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__compare_fc02a284-d30f-47e0-87ae-ddd88c9b9372.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__baseline_fc02a284-d30f-47e0-87ae-ddd88c9b9372.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__compare_fc02a284-d30f-47e0-87ae-ddd88c9b9372.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.699982327803188 > 2.4741384509265805. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -153.16659155874927 (T) = (0 -14.846733517141212) / Math.Sqrt((0.05974672539167397 / (32)) + (0.02495339318210888 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -5.864714579805759 = (2.1627604971103267 - 14.846733517141212) / 2.1627604971103267 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__baseline_edbc711f-7dc9-4722-aaa2-f8d7a1f7124e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__compare_edbc711f-7dc9-4722-aaa2-f8d7a1f7124e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__baseline_edbc711f-7dc9-4722-aaa2-f8d7a1f7124e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__compare_edbc711f-7dc9-4722-aaa2-f8d7a1f7124e.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).IDictionary(Size%3a%20512).html>)	13.71 μs	20.08 μs	1.46	0.04	True	82978.03617571059	125699.14298601715	1.514848371680456)	Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).Dictionary(Size%3a%20512).html>)	13.83 μs	19.32 μs	1.40	0.20	False	80716.68264621285	122431.28272251309	1.5168027068101695)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.08326424592973 > 14.387490783552625. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -85.78779638241521 (T) = (0 -20139.262217738116) / Math.Sqrt((32986.73794669107 / (32)) + (22256.195523414674 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.4606957325599509 = (13787.445098126585 - 20139.262217738116) / 13787.445098126585 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__baseline_d41f2d32-dbcf-4501-8ab5-de5c57d88422.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__compare_d41f2d32-dbcf-4501-8ab5-de5c57d88422.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__baseline_d41f2d32-dbcf-4501-8ab5-de5c57d88422.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__compare_d41f2d32-dbcf-4501-8ab5-de5c57d88422.log) #### System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.323459517923364 > 14.978438523057433. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -39.513950266302345 (T) = (0 -19270.761181977356) / Math.Sqrt((571356.9135199911 / (32)) + (11252.808868958598 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.40992533261127667 = (13667.930305420223 - 19270.761181977356) / 13667.930305420223 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__baseline_32d1884d-fed2-4a36-b4bb-27cc817af872.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__compare_32d1884d-fed2-4a36-b4bb-27cc817af872.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__baseline_32d1884d-fed2-4a36-b4bb-27cc817af872.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__compare_32d1884d-fed2-4a36-b4bb-27cc817af872.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20NonBacktracking).html>)	343.97 μs	363.40 μs	1.06	0.00	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: NonBacktracking) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 363.4017520215633 > 361.7632134880091. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -22.91513711931553 (T) = (0 -366725.9353054071) / Math.Sqrt((6920197.259113348 / (32)) + (3541742.8434655108 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.0639248698449106 = (344691.5714629973 - 366725.9353054071) / 344691.5714629973 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Net.Primitives.Tests.CredentialCacheTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[GetCredential_HostPort - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host%3a%20%22notfound%22%2c%20hostPortCount%3a%2010).html>)	55.27 ns	62.41 ns	1.13	0.23	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.CredentialCacheTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host: "notfound", hostPortCount: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.414100818463574 > 58.50294156854603. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -5.823392263933178 (T) = (0 -60.98629497841891) / Math.Sqrt((3.0778805688614947 / (32)) + (1.9542008885255013 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07139513559104396 = (56.922318342219576 - 60.98629497841891) / 56.922318342219576 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Net_Primitives_Tests_CredentialCacheTests_GetCredential_HostPort_host___notfound___hostPortCo_baseline_a36b9b50-92f1-4b04-8d81-e431d4a790d2.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Net_Primitives_Tests_CredentialCacheTests_GetCredential_HostPort_host___notfound___hostPortCo_compare_a36b9b50-92f1-4b04-8d81-e431d4a790d2.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_GetCredential_HostPort_host___notfound___hostPortCo_baseline_a36b9b50-92f1-4b04-8d81-e431d4a790d2.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Net_Primitives_Tests_CredentialCacheTests_GetCredential_HostPort_host___notfound___hostPortCo_compare_a36b9b50-92f1-4b04-8d81-e431d4a790d2.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	5.83 μs	7.40 μs	1.27	0.10	False	36111.11111111111	51692.65271251602	1.4314888443465976)	Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	5.15 μs	9.25 μs	1.80	0.21	True	36769.73104056437	52850.50675675676	1.4373373223332004)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.404639767185778 > 6.121403036167097. IsChangePoint: Marked as a change because one of 2/24/2023 12:59:32 PM, 3/15/2023 12:03:45 AM, 3/31/2023 8:05:26 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -6.047277322842543 (T) = (0 -6849.319000289023) / Math.Sqrt((61207.550259096635 / (32)) + (244568.20537880395 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.24851373256392556 = (5485.97810472087 - 6849.319000289023) / 5485.97810472087 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__baseline_ac709990-c155-4836-8d1d-8f7c49da6464.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__compare_ac709990-c155-4836-8d1d-8f7c49da6464.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__baseline_ac709990-c155-4836-8d1d-8f7c49da6464.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__compare_ac709990-c155-4836-8d1d-8f7c49da6464.log) #### System.Collections.ContainsKeyTrue<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.25472970971564 > 5.96172117172506. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -17.532491562240985 (T) = (0 -8623.909768781898) / Math.Sqrt((250288.74759935445 / (32)) + (142188.61270386528 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.631648394194664 = (5285.397147734404 - 8623.909768781898) / 5285.397147734404 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__baseline_666e64e5-542b-4a27-8f76-57f7a7abf1bf.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__compare_666e64e5-542b-4a27-8f76-57f7a7abf1bf.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__baseline_666e64e5-542b-4a27-8f76-57f7a7abf1bf.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__compare_666e64e5-542b-4a27-8f76-57f7a7abf1bf.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToStream(Mode%3a%20Reflection).html>)	585.46 ns	673.92 ns	1.15	0.20	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToString(Mode%3a%20SourceGen).html>)	398.33 ns	438.38 ns	1.10	0.06	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToWriter(Mode%3a%20SourceGen).html>)	276.10 ns	306.54 ns	1.11	0.01	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToWriter(Mode%3a%20Reflection).html>)	407.73 ns	452.32 ns	1.11	0.07	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	346.64 ns	388.61 ns	1.12	0.04	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToString(Mode%3a%20Reflection).html>)	537.69 ns	585.44 ns	1.09	0.07	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToUtf8Bytes(Mode%3a%20Reflection).html>)	480.50 ns	532.02 ns	1.11	0.08	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ClassRecord&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToStream(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 673.9215451229967 > 613.3376967266075. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -10.088683800869006 (T) = (0 -659.6353129484266) / Math.Sqrt((294.4185745761366 / (32)) + (132.03064990056254 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.10042885457497039 = (599.434766006026 - 659.6353129484266) / 599.434766006026 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 438.3806362142498 > 418.2251157268082. IsChangePoint: Marked as a change because one of 2/13/2023 6:54:14 PM, 3/15/2023 5:33:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -9.232894953026758 (T) = (0 -433.59500583857215) / Math.Sqrt((48.03495458048816 / (32)) + (60.48373487220113 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.08521251189376426 = (399.5484765301144 - 433.59500583857215) / 399.5484765301144 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 306.54295638062075 > 286.51073404508304. IsChangePoint: Marked as a change because one of 3/15/2023 5:33:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -14.88763310539389 (T) = (0 -307.97982278459705) / Math.Sqrt((20.17607421028965 / (32)) + (20.184345165597065 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.11661158553497734 = (275.8164314021885 - 307.97982278459705) / 275.8164314021885 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 452.3224430422048 > 425.7197214752633. IsChangePoint: Marked as a change because one of 3/27/2023 8:33:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -27.22323557635955 (T) = (0 -451.9607250167511) / Math.Sqrt((33.42366946827809 / (32)) + (10.064198816199307 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.11771785865617083 = (404.36029675694925 - 451.9607250167511) / 404.36029675694925 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 388.6060187615073 > 362.11318537092825. IsChangePoint: Marked as a change because one of 3/20/2023 11:25:43 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -6.89401644444975 (T) = (0 -393.97982307200624) / Math.Sqrt((117.51610401311972 / (32)) + (154.3887311563907 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1146463523521819 = (353.4572398147722 - 393.97982307200624) / 353.4572398147722 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToString(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 585.4425224720569 > 563.3273563555207. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -8.201649443293753 (T) = (0 -589.9819043012851) / Math.Sqrt((115.31552764339796 / (32)) + (178.97404323171514 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.09559904479078886 = (538.5016599881626 - 589.9819043012851) / 538.5016599881626 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToUtf8Bytes(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 532.0226086906882 > 507.4936143931926. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -9.760502572498213 (T) = (0 -535.4625820646272) / Math.Sqrt((129.144290822343 / (32)) + (108.66820446116459 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.10196807443984407 = (485.91478690234766 - 535.4625820646272) / 485.91478690234766 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	191.39 ns	218.99 ns	1.14	0.10	False	1859.454978011679	1962.6036721993903	1.0554725419047297)	Trace	Trace
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToString(Mode%3a%20SourceGen).html>)	210.85 ns	228.95 ns	1.09	0.10	False				Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToWriter(Mode%3a%20Reflection).html>)	189.73 ns	216.24 ns	1.14	0.04	False	1721.3608957795004	1808.9575795075978	1.0508880409348615)	Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToWriter(Mode%3a%20SourceGen).html>)	116.94 ns	133.26 ns	1.14	0.05	False	1141.9897700206943	1242.2824505281512	1.0878227486272836)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;SimpleStructWithProperties&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 218.99156899694023 > 200.37321056314138. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -10.387700391260573 (T) = (0 -211.6780307357004) / Math.Sqrt((19.72971827657661 / (32)) + (17.065302193829766 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1092732609152145 = (190.82586608195513 - 211.6780307357004) / 190.82586608195513 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_baseline_c0d59018-3e65-41d3-8121-9babb2a9d1be.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_compare_c0d59018-3e65-41d3-8121-9babb2a9d1be.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_baseline_c0d59018-3e65-41d3-8121-9babb2a9d1be.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_compare_c0d59018-3e65-41d3-8121-9babb2a9d1be.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 228.95460451253288 > 222.21846525295376. IsChangePoint: Marked as a change because one of 3/24/2023 7:28:10 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -13.024256431542245 (T) = (0 -228.6659328432615) / Math.Sqrt((19.33162030757691 / (32)) + (4.12967598538629 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07309090565821737 = (213.09092420553256 - 228.6659328432615) / 213.09092420553256 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_baseline_1ef4165b-75dd-49f8-adbc-6db5eab26a7f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_compare_1ef4165b-75dd-49f8-adbc-6db5eab26a7f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_baseline_1ef4165b-75dd-49f8-adbc-6db5eab26a7f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_compare_1ef4165b-75dd-49f8-adbc-6db5eab26a7f.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 216.24190992910735 > 199.00770091578087. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -4.969749591304523 (T) = (0 -205.53544794644228) / Math.Sqrt((8.416289188213081 / (32)) + (39.33838260019077 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07405197643655666 = (191.36452653656383 - 205.53544794644228) / 191.36452653656383 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_baseline_cc80626c-e4f7-47ac-827e-149990d51874.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_compare_cc80626c-e4f7-47ac-827e-149990d51874.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_baseline_cc80626c-e4f7-47ac-827e-149990d51874.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_compare_cc80626c-e4f7-47ac-827e-149990d51874.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 133.2595815206132 > 122.77459747595911. IsChangePoint: Marked as a change because one of 2/15/2023 8:55:14 PM, 3/21/2023 2:16:57 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -41.03913385196143 (T) = (0 -134.06826429834004) / Math.Sqrt((0.871696371946476 / (32)) + (0.6942774458803908 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.14253491756483416 = (117.34281573125945 - 134.06826429834004) / 117.34281573125945 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_baseline_5adb4627-0a0e-48e7-adc0-182cb9554677.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_compare_5adb4627-0a0e-48e7-adc0-182cb9554677.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_baseline_5adb4627-0a0e-48e7-adc0-182cb9554677.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_compare_5adb4627-0a0e-48e7-adc0-182cb9554677.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Decimal

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Decimal.ToString(value%3a%20123456.789).html>)	75.60 ns	82.19 ns	1.09	0.02	False	761.5190870360386	811.4175103625106	1.0655248491809772)	Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Decimal*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Decimal.ToString(value: 123456.789) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 82.19495353651673 > 79.53434403373535. IsChangePoint: Marked as a change because one of 2/17/2023 5:12:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -11.681188234621297 (T) = (0 -82.89566464465686) / Math.Sqrt((1.3815653505708694 / (32)) + (0.9937733475223884 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.07447216284192384 = (77.1501277663649 - 82.89566464465686) / 77.1501277663649 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Decimal_ToString_value__123456_789__baseline_4f3dbfb4-4a26-4029-9ea6-44f20ba2bc70.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Decimal_ToString_value__123456_789__compare_4f3dbfb4-4a26-4029-9ea6-44f20ba2bc70.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Decimal_ToString_value__123456_789__baseline_4f3dbfb4-4a26-4029-9ea6-44f20ba2bc70.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Decimal_ToString_value__123456_789__compare_4f3dbfb4-4a26-4029-9ea6-44f20ba2bc70.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.Parse(value%3a%20%220%22).html>)	0.46 ns	9.71 ns	20.97	0.38	False				Trace	Trace
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.TryFormat(value%3a%2012345).html>)	9.06 ns	10.52 ns	1.16	0.02	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.Parse(value: "0") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.70952634744849 > 0.41981476096963627. IsChangePoint: Marked as a change because one of 4/7/2023 2:04:47 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -17.11908128411902 (T) = (0 -9.697503809252614) / Math.Sqrt((7.703578416058963 / (32)) + (0.0007030156163497868 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -6.485041649379094 = (1.2955844821594347 - 9.697503809252614) / 1.2955844821594347 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_Parse_value___0___baseline_bf476d1c-2d24-448b-a507-704f9ea2cf64.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_Parse_value___0___compare_bf476d1c-2d24-448b-a507-704f9ea2cf64.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___baseline_bf476d1c-2d24-448b-a507-704f9ea2cf64.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___compare_bf476d1c-2d24-448b-a507-704f9ea2cf64.log) #### System.Tests.Perf_UInt64.TryFormat(value: 12345) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.523106564938587 > 9.466277963302394. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -44.266678183795825 (T) = (0 -10.534823913613552) / Math.Sqrt((0.012729432361973547 / (32)) + (0.003665346000947786 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.16455665734235225 = (9.046209857797036 - 10.534823913613552) / 9.046209857797036 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__12345__baseline_5e5d8f64-7747-4acb-997c-9123734eec30.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__12345__compare_5e5d8f64-7747-4acb-997c-9123734eec30.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__12345__baseline_5e5d8f64-7747-4acb-997c-9123734eec30.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__12345__compare_5e5d8f64-7747-4acb-997c-9123734eec30.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Deep

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	6.72 ms	7.68 ms	1.14	0.00	False				Trace	Trace
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	7.24 ms	7.79 ms	1.08	0.01	False	59830630.630630635	67232258.06451613	1.123709667704826)	Trace	Trace
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	6.91 ms	7.54 ms	1.09	0.01	False				Trace	Trace
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	6.66 ms	7.65 ms	1.15	0.01	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.684696161616161 > 7.067837378378378. IsChangePoint: Marked as a change because one of 2/20/2023 2:42:44 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -10.546648119619126 (T) = (0 -7803050.095815296) / Math.Sqrt((10163145317.08042 / (32)) + (39296857026.734375 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1392390744193506 = (6849352.581934893 - 7803050.095815296) / 6849352.581934893 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__baseline_163b7b2e-db47-4ef0-a62a-174d08522bd3.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__compare_163b7b2e-db47-4ef0-a62a-174d08522bd3.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__baseline_163b7b2e-db47-4ef0-a62a-174d08522bd3.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__compare_163b7b2e-db47-4ef0-a62a-174d08522bd3.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.787404241071428 > 7.563964600000002. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 8:42:09 PM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -23.60859117178198 (T) = (0 -7794210.39745116) / Math.Sqrt((38331513316.012924 / (32)) + (1372615635.5379286 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.13151272416219678 = (6888309.986281602 - 7794210.39745116) / 6888309.986281602 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__baseline_8d247c63-c1c4-4d54-a269-25b62d5a7a63.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__compare_8d247c63-c1c4-4d54-a269-25b62d5a7a63.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__baseline_8d247c63-c1c4-4d54-a269-25b62d5a7a63.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__compare_8d247c63-c1c4-4d54-a269-25b62d5a7a63.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.542852916666667 > 7.239037239583334. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 3/14/2023 8:42:09 PM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -21.077014490755364 (T) = (0 -7614266.5) / Math.Sqrt((50606568163.74784 / (32)) + (2287675247.6215115 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1428490937912862 = (6662530.111250683 - 7614266.5) / 6662530.111250683 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__baseline_d16fbd44-5dab-4f1f-b821-262842375f88.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__compare_d16fbd44-5dab-4f1f-b821-262842375f88.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__baseline_d16fbd44-5dab-4f1f-b821-262842375f88.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__compare_d16fbd44-5dab-4f1f-b821-262842375f88.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.654981818181818 > 6.929333618421052. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -27.91250672561855 (T) = (0 -7691391.4290209785) / Math.Sqrt((5048991008.418026 / (32)) + (7564418316.155207 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.17416820792978252 = (6550502.199835527 - 7691391.4290209785) / 6550502.199835527 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__baseline_c7138579-96b6-49b8-b72e-c5dfc7dfdecf.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__compare_c7138579-96b6-49b8-b72e-c5dfc7dfdecf.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__baseline_c7138579-96b6-49b8-b72e-c5dfc7dfdecf.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__compare_c7138579-96b6-49b8-b72e-c5dfc7dfdecf.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	7.15 μs	8.33 μs	1.17	0.48	False	41881.39260424862	57377.961874220564	1.3700108402890097)	Trace	Trace
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).FrozenDictionary(Size%3a%20512).html>)	6.36 μs	9.16 μs	1.44	0.03	True	42481.21741796995	57919.476803596976	1.3634137702253444)	Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	3.93 μs	8.47 μs	2.15	0.08	True				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryGetValueTrue<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.329072444444442 > 7.1742048856637775. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -17.317132020081825 (T) = (0 -8269.343548385757) / Math.Sqrt((193722.43970650915 / (32)) + (7877.781333829158 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.22386307153367502 = (6756.755506989103 - 8269.343548385757) / 6756.755506989103 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__baseline_316c06f5-a8d4-4a68-bfe1-6045b57e56cf.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__compare_316c06f5-a8d4-4a68-bfe1-6045b57e56cf.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__baseline_316c06f5-a8d4-4a68-bfe1-6045b57e56cf.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__compare_316c06f5-a8d4-4a68-bfe1-6045b57e56cf.log) #### System.Collections.TryGetValueTrue<Int32, Int32>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.16098387096774 > 6.670117349151122. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -45.47965626478714 (T) = (0 -9240.081984459244) / Math.Sqrt((44363.53627850543 / (32)) + (12797.270515300981 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.44755253535630934 = (6383.244655217183 - 9240.081984459244) / 6383.244655217183 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__baseline_2aedb018-070b-4d66-9b6e-a241c3411fa3.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__compare_2aedb018-070b-4d66-9b6e-a241c3411fa3.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__baseline_2aedb018-070b-4d66-9b6e-a241c3411fa3.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__compare_2aedb018-070b-4d66-9b6e-a241c3411fa3.log) #### System.Collections.TryGetValueTrue<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.465123922413794 > 4.128482684625313. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -18.72885354028453 (T) = (0 -8055.67938433917) / Math.Sqrt((91053.39198408587 / (32)) + (202278.52909081202 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.9372032918468559 = (4158.406821959915 - 8055.67938433917) / 4158.406821959915 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__baseline_5cb7d94b-5365-40ec-bd79-bbc89ecfac0a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__compare_5cb7d94b-5365-40ec-bd79-bbc89ecfac0a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__baseline_5cb7d94b-5365-40ec-bd79-bbc89ecfac0a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__compare_5cb7d94b-5365-40ec-bd79-bbc89ecfac0a.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int16.ToString(value%3a%2032767).html>)	8.09 ns	9.58 ns	1.18	0.03	False	105.82617640517918	113.2176273208391	1.0698452043411273)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int16*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int16.ToString(value: 32767) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.583928630535372 > 8.527720256285798. IsChangePoint: Marked as a change because one of 1/31/2023 6:07:33 PM, 2/13/2023 6:54:14 PM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -4.492166712363752 (T) = (0 -8.942910371065429) / Math.Sqrt((0.031804662055131515 / (32)) + (0.14885303217444287 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.09661781936892862 = (8.154992754186514 - 8.942910371065429) / 8.154992754186514 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int16_ToString_value__32767__baseline_18cd4095-74d5-4dee-904f-dbdd0fc1ac2a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int16_ToString_value__32767__compare_18cd4095-74d5-4dee-904f-dbdd0fc1ac2a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int16_ToString_value__32767__baseline_18cd4095-74d5-4dee-904f-dbdd0fc1ac2a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int16_ToString_value__32767__compare_18cd4095-74d5-4dee-904f-dbdd0fc1ac2a.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(Int32).SerializeToWriter(Mode%3a%20Reflection).html>)	56.72 ns	61.81 ns	1.09	0.28	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 61.80696233803129 > 59.55483540091958. IsChangePoint: Marked as a change because one of 3/20/2023 10:25:17 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -3.6057485532489046 (T) = (0 -63.67167276862365) / Math.Sqrt((8.840583700805755 / (32)) + (10.994938592274378 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.097810781087122 = (57.998767971263604 - 63.67167276862365) / 57.998767971263604 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__baseline_fc1725f4-f0c9-4b9b-9bae-dd153744b10b.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__compare_fc1725f4-f0c9-4b9b-9bae-dd153744b10b.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__baseline_fc1725f4-f0c9-4b9b-9bae-dd153744b10b.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__compare_fc1725f4-f0c9-4b9b-9bae-dd153744b10b.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndRemove(Int32).Dictionary(Size%3a%20512).html>)	21.07 μs	28.84 μs	1.37	0.08	False				Trace	Trace
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndRemove(Int32).HashSet(Size%3a%20512).html>)	17.61 μs	18.68 μs	1.06	0.01	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.837482670979668 > 22.12027637768817. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -48.23552935634203 (T) = (0 -28589.602475081734) / Math.Sqrt((215822.72818731985 / (32)) + (79535.20067287829 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.3403498771669859 = (21329.954933490797 - 28589.602475081734) / 21329.954933490797 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__baseline_c9fa962d-e4b8-43e8-9881-d52c51bb9828.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__compare_c9fa962d-e4b8-43e8-9881-d52c51bb9828.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__baseline_c9fa962d-e4b8-43e8-9881-d52c51bb9828.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__compare_c9fa962d-e4b8-43e8-9881-d52c51bb9828.log) #### System.Collections.CreateAddAndRemove<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.67638410530483 > 17.912617049787087. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -19.24662993880345 (T) = (0 -18752.862836523367) / Math.Sqrt((59083.55201434229 / (32)) + (25375.4183672286 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.09335714038353057 = (17151.63521952689 - 18752.862836523367) / 17151.63521952689 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__baseline_72ab9bb5-2d85-42f3-97b1-9e8c40eabce2.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__compare_72ab9bb5-2d85-42f3-97b1-9e8c40eabce2.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__baseline_72ab9bb5-2d85-42f3-97b1-9e8c40eabce2.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__compare_72ab9bb5-2d85-42f3-97b1-9e8c40eabce2.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IntegerFormatting - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.IntegerFormatting.html>)	1.24 ms	1.43 ms	1.15	0.03	False	14044791.666666666	15209114.583333332	1.0829006897574722)	Trace	Trace
[InstanceDelegate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.InstanceDelegate.html>)	219.00 μs	249.46 μs	1.14	0.03	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.LowLevelPerf.IntegerFormatting ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.4283228146853146 > 1.3057933039772727. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -169.67152813894563 (T) = (0 -1425926.7626123878) / Math.Sqrt((13571184.26248604 / (32)) + (3566930.513075033 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.1453530248503677 = (1244967.0378254557 - 1425926.7626123878) / 1244967.0378254557 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_IntegerFormatting_baseline_4281e672-f5ea-4c44-858d-c57ef8c30800.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_IntegerFormatting_compare_4281e672-f5ea-4c44-858d-c57ef8c30800.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_IntegerFormatting_baseline_4281e672-f5ea-4c44-858d-c57ef8c30800.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_IntegerFormatting_compare_4281e672-f5ea-4c44-858d-c57ef8c30800.log) #### PerfLabTests.LowLevelPerf.InstanceDelegate ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 249.46444869614513 > 229.20084411725426. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/13/2023 6:54:14 PM, 2/16/2023 9:36:08 AM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 8:42:09 PM, 3/25/2023 12:18:49 AM, 4/10/2023 1:33:42 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -251.0204174997296 (T) = (0 -249734.9531960888) / Math.Sqrt((99093.91570300455 / (21)) + (172902.25379069935 / (16))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (16) - 2, .025) and -0.14317241020944532 = (218457.8205052498 - 249734.9531960888) / 218457.8205052498 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_InstanceDelegate_baseline_496e6cf8-8cb6-4443-9817-4d5172facf33.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_InstanceDelegate_compare_496e6cf8-8cb6-4443-9817-4d5172facf33.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_InstanceDelegate_baseline_496e6cf8-8cb6-4443-9817-4d5172facf33.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_InstanceDelegate_compare_496e6cf8-8cb6-4443-9817-4d5172facf33.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryAddGiventSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryAddGiventSize(Int32).Dictionary(Count%3a%20512).html>)	8.06 μs	11.68 μs	1.45	0.12	False	50236.42322097379	67885.55298947908	1.3513213847027379)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddGiventSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.682526529338327 > 8.432152827833685. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -50.24145203731936 (T) = (0 -11678.934939479446) / Math.Sqrt((57840.19235081022 / (32)) + (14999.83539613941 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.42506039970327475 = (8195.396449098738 - 11678.934939479446) / 8195.396449098738 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__baseline_2964f6d8-453a-4c4a-92ef-32523e58b947.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__compare_2964f6d8-453a-4c4a-92ef-32523e58b947.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__baseline_2964f6d8-453a-4c4a-92ef-32523e58b947.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__compare_2964f6d8-453a-4c4a-92ef-32523e58b947.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).FrozenDictionary(Size%3a%20512).html>)	6.18 μs	8.00 μs	1.30	0.01	True				Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).Dictionary(Size%3a%20512).html>)	6.09 μs	7.76 μs	1.27	0.00	True	38094.501718213054	53462.89600550965	1.4034281482660511)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<String>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.998281356947296 > 6.483211375641785. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -55.507392837427055 (T) = (0 -7960.899443798352) / Math.Sqrt((6621.441818322525 / (32)) + (3904.844726107646 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.2806567642962355 = (6216.263143835528 - 7960.899443798352) / 6216.263143835528 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__baseline_bfc90e35-7904-4cea-ac8d-8f3181f2908f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__compare_bfc90e35-7904-4cea-ac8d-8f3181f2908f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__baseline_bfc90e35-7904-4cea-ac8d-8f3181f2908f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__compare_bfc90e35-7904-4cea-ac8d-8f3181f2908f.log) #### System.Collections.CtorFromCollection<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.756489955357142 > 6.396525421868904. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -75.29484224821859 (T) = (0 -7773.597688368444) / Math.Sqrt((12460.089973253858 / (32)) + (290.4124504467738 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.2576873620449468 = (6180.866503841544 - 7773.597688368444) / 6180.866503841544 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__Dictionary_Size__512__baseline_dd810399-fdec-4b2f-b48e-027684c04312.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__Dictionary_Size__512__compare_dd810399-fdec-4b2f-b48e-027684c04312.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__Dictionary_Size__512__baseline_dd810399-fdec-4b2f-b48e-027684c04312.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__Dictionary_Size__512__compare_dd810399-fdec-4b2f-b48e-027684c04312.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString_Format_Flags_Large - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Enum.ToString_Format_Flags_Large(value%3a%20All%2c%20format%3a%20%22d%22).html>)	17.90 ns	19.57 ns	1.09	0.07	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Enum.ToString_Format_Flags_Large(value: All, format: "d") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.565165402579918 > 18.871787750587444. IsChangePoint: Marked as a change because one of 3/16/2023 1:49:47 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -21.441084841434613 (T) = (0 -19.665016232139955) / Math.Sqrt((0.10064217603828977 / (31)) + (0.006647396986133154 / (5))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (5) - 2, .025) and -0.0796287606804164 = (18.214609454963423 - 19.665016232139955) / 18.214609454963423 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Enum_ToString_Format_Flags_Large_value__All__format___d___baseline_d717594e-ea75-4129-9700-e9b461c2b439.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Enum_ToString_Format_Flags_Large_value__All__format___d___compare_d717594e-ea75-4129-9700-e9b461c2b439.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Enum_ToString_Format_Flags_Large_value__All__format___d___baseline_d717594e-ea75-4129-9700-e9b461c2b439.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Enum_ToString_Format_Flags_Large_value__All__format___d___compare_d717594e-ea75-4129-9700-e9b461c2b439.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IndexerSet<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.IndexerSet(Int32).Dictionary(Size%3a%20512).html>)	5.77 μs	11.19 μs	1.94	0.11	True	40727.28944464877	59347.00206753963	1.4571802562062557)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.IndexerSet<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.185980542754738 > 6.0961168814265. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -50.996799821984645 (T) = (0 -11016.819073623681) / Math.Sqrt((14225.78626905753 / (32)) + (53072.39957022107 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.9485357997560846 = (5653.896158850534 - 11016.819073623681) / 5653.896158850534 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_IndexerSet_Int32__Dictionary_Size__512__baseline_d1d6ced4-2370-44d0-8d5a-02abe1d272fe.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_IndexerSet_Int32__Dictionary_Size__512__compare_d1d6ced4-2370-44d0-8d5a-02abe1d272fe.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_IndexerSet_Int32__Dictionary_Size__512__baseline_d1d6ced4-2370-44d0-8d5a-02abe1d272fe.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_IndexerSet_Int32__Dictionary_Size__512__compare_d1d6ced4-2370-44d0-8d5a-02abe1d272fe.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryAddDefaultSize(Int32).Dictionary(Count%3a%20512).html>)	12.90 μs	19.12 μs	1.48	0.20	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.115367550136522 > 14.27965246842212. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -59.55829573517693 (T) = (0 -19217.568522737165) / Math.Sqrt((209847.69814327767 / (32)) + (11194.36100065714 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.40978285707029555 = (13631.58051352225 - 19217.568522737165) / 13631.58051352225 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__baseline_7c52d675-2a7d-47e3-af88-dfa6f6d27113.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__compare_7c52d675-2a7d-47e3-af88-dfa6f6d27113.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__baseline_7c52d675-2a7d-47e3-af88-dfa6f6d27113.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__compare_7c52d675-2a7d-47e3-af88-dfa6f6d27113.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryFormat(value%3a%20-9223372036854775808).html>)	58.21 ns	62.90 ns	1.08	0.00	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.897368894662996 > 61.171166643086806. IsChangePoint: Marked as a change because one of 2/19/2023 8:14:07 AM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -16.185043767295042 (T) = (0 -63.39417946600734) / Math.Sqrt((0.11796036789124008 / (32)) + (0.4419358389802929 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.08397518992504037 = (58.483053906788406 - 63.39417946600734) / 58.483053906788406 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__baseline_bd52d0f1-56ed-4b91-be1e-46af9654ab3a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__compare_bd52d0f1-56ed-4b91-be1e-46af9654ab3a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__baseline_bd52d0f1-56ed-4b91-be1e-46af9654ab3a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__compare_bd52d0f1-56ed-4b91-be1e-46af9654ab3a.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int32.ToString(value%3a%202147483647).html>)	10.69 ns	12.84 ns	1.20	0.05	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int32.ToString(value: 2147483647) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.839668353330383 > 11.279886484197705. IsChangePoint: Marked as a change because one of 3/2/2023 7:59:08 PM, 3/13/2023 2:14:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -36.31725837620608 (T) = (0 -12.929022474795184) / Math.Sqrt((0.04881510648655721 / (32)) + (0.009361713779489703 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.19579626985742352 = (10.812061218703024 - 12.929022474795184) / 10.812061218703024 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int32_ToString_value__2147483647__baseline_8c1335ad-4be6-4f8c-b51a-9b0321d5c536.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int32_ToString_value__2147483647__compare_8c1335ad-4be6-4f8c-b51a-9b0321d5c536.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int32_ToString_value__2147483647__baseline_8c1335ad-4be6-4f8c-b51a-9b0321d5c536.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int32_ToString_value__2147483647__compare_8c1335ad-4be6-4f8c-b51a-9b0321d5c536.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Tests.Perf_Dictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Clone - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.Perf_Dictionary.Clone(Items%3a%203000).html>)	16.61 μs	25.46 μs	1.53	0.01	True	132174.03958090802	229690.00767566814	1.7377845786052972)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_Dictionary.Clone(Items: 3000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.459275462671535 > 17.443096664666566. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 7:36:21 AM falls between 4/9/2023 7:17:29 PM and 4/18/2023 7:36:21 AM. IsRegressionStdDev: Marked as regression because -28.06985248846506 (T) = (0 -26279.300607777892) / Math.Sqrt((17450.463981356523 / (31)) + (597094.3823694665 / (5))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (5) - 2, .025) and -0.5872635532863 = (16556.356096861633 - 26279.300607777892) / 16556.356096861633 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_Perf_Dictionary_Clone_Items__3000__baseline_eb1462ea-ef3c-4bf5-83b6-48b880d2ec61.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_Perf_Dictionary_Clone_Items__3000__compare_eb1462ea-ef3c-4bf5-83b6-48b880d2ec61.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_Perf_Dictionary_Clone_Items__3000__baseline_eb1462ea-ef3c-4bf5-83b6-48b880d2ec61.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_Perf_Dictionary_Clone_Items__3000__compare_eb1462ea-ef3c-4bf5-83b6-48b880d2ec61.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>)	8.06 μs	11.67 μs	1.45	0.14	False				Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).IDictionary(Size%3a%20512).html>)	8.39 μs	11.86 μs	1.41	0.13	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads