[Perf] Windows/x86: 95 Regressions on 4/17/2023 1:30:24 AM

graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;LargeStructWithProperties&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToString(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 949.9054212168487 > 912.3759528908188. IsChangePoint: Marked as a change because one of 2/13/2023 12:37:33 PM, 3/14/2023 10:43:28 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.664853415714981 (T) = (0 -944.704297337569) / Math.Sqrt((110.31556051143252 / (33)) + (130.69576737396326 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.08003381853232093 = (874.6988113958747 - 944.704297337569) / 874.6988113958747 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__Re_baseline_b701cbda-a0f1-4861-b77b-69d00a62f161.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__Re_compare_b701cbda-a0f1-4861-b77b-69d00a62f161.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__Re_baseline_b701cbda-a0f1-4861-b77b-69d00a62f161.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__Re_compare_b701cbda-a0f1-4861-b77b-69d00a62f161.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 480.8798160307234 > 423.73931764176854. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.15271344894198 (T) = (0 -479.6529901454701) / Math.Sqrt((65.33445033318212 / (33)) + (5.5988340230463685 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1872604884592673 = (403.9997917962601 - 479.6529901454701) / 403.9997917962601 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_baseline_f47fef13-3244-4176-b3bc-7302b36b84b8.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_compare_f47fef13-3244-4176-b3bc-7302b36b84b8.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_baseline_f47fef13-3244-4176-b3bc-7302b36b84b8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__So_compare_f47fef13-3244-4176-b3bc-7302b36b84b8.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.2061204985435516 > 1.1706854723932076. IsChangePoint: Marked as a change because one of 2/15/2023 8:48:29 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.787524514299324 (T) = (0 -1196.1047420226346) / Math.Sqrt((221.84424842252616 / (33)) + (125.6342755702197 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.07068352134139332 = (1117.1412636706211 - 1196.1047420226346) / 1117.1412636706211 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_702b9717-deac-4d3c-b0c7-4b31e64f9d94.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_702b9717-deac-4d3c-b0c7-4b31e64f9d94.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_702b9717-deac-4d3c-b0c7-4b31e64f9d94.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_702b9717-deac-4d3c-b0c7-4b31e64f9d94.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToStream(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 640.5845099094623 > 573.5324685191792. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.593248253730088 (T) = (0 -634.4907595662959) / Math.Sqrt((70.61582321849802 / (33)) + (161.5472835697732 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14867598225271417 = (552.3670463814964 - 634.4907595662959) / 552.3670463814964 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_baseline_f0e5ff45-d330-4c04-8dbf-d3f75fa050b6.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_compare_f0e5ff45-d330-4c04-8dbf-d3f75fa050b6.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_baseline_f0e5ff45-d330-4c04-8dbf-d3f75fa050b6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__So_compare_f0e5ff45-d330-4c04-8dbf-d3f75fa050b6.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 798.5966211259857 > 784.480636458238. IsChangePoint: Marked as a change because one of 2/8/2023 3:55:57 PM, 2/21/2023 5:46:41 AM, 3/27/2023 3:21:55 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.445695836331225 (T) = (0 -803.3846850119164) / Math.Sqrt((53.22400143317904 / (33)) + (10.643026826880726 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.06129766555349606 = (756.983371477529 - 803.3846850119164) / 756.983371477529 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_baseline_c2d34a69-76b0-4a98-b800-6a6f04f639cb.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_compare_c2d34a69-76b0-4a98-b800-6a6f04f639cb.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_baseline_c2d34a69-76b0-4a98-b800-6a6f04f639cb.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToWriter_Mode__Re_compare_c2d34a69-76b0-4a98-b800-6a6f04f639cb.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 594.2666348600508 > 506.57173150034413. IsChangePoint: Marked as a change because one of 2/20/2023 2:42:44 PM, 3/21/2023 7:06:30 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.42379716681913 (T) = (0 -572.7640469521973) / Math.Sqrt((30.644552439352488 / (33)) + (217.42014393494887 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.19229115839471075 = (480.3894106900543 - 572.7640469521973) / 480.3894106900543 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_06540661-a772-4126-a80c-2daa3c21849c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_06540661-a772-4126-a80c-2daa3c21849c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_06540661-a772-4126-a80c-2daa3c21849c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_06540661-a772-4126-a80c-2daa3c21849c.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToStream(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 991.5048114794237 > 963.6128265650051. IsChangePoint: Marked as a change because one of 2/12/2023 9:12:37 PM, 3/2/2023 5:44:02 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.568411214132238 (T) = (0 -981.68573866293) / Math.Sqrt((82.98750293062493 / (33)) + (83.77537158696926 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.0661090181648477 = (920.8117762222478 - 981.68573866293) / 920.8117762222478 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_baseline_bf2e2395-6420-41bd-b24e-e4cc429a8c36.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_compare_bf2e2395-6420-41bd-b24e-e4cc429a8c36.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_baseline_bf2e2395-6420-41bd-b24e-e4cc429a8c36.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToStream_Mode__Re_compare_bf2e2395-6420-41bd-b24e-e4cc429a8c36.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 626.1202746375938 > 552.915610224322. IsChangePoint: Marked as a change because one of 3/17/2023 9:25:32 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.687521984883105 (T) = (0 -628.6544740783958) / Math.Sqrt((48.2159431836111 / (33)) + (143.25970140732247 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.19341282963675935 = (526.7703333386655 - 628.6544740783958) / 526.7703333386655 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_baseline_c9bfaba4-75b4-4d00-9b3e-71874cee77f4.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_compare_c9bfaba4-75b4-4d00-9b3e-71874cee77f4.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_baseline_c9bfaba4-75b4-4d00-9b3e-71874cee77f4.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToString_Mode__So_compare_c9bfaba4-75b4-4d00-9b3e-71874cee77f4.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 874.5906239616173 > 850.7440726911116. IsChangePoint: Marked as a change because one of 3/17/2023 9:25:32 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.39464180262302 (T) = (0 -881.8390512835393) / Math.Sqrt((215.30810110969944 / (33)) + (236.2248641352376 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.09441975273322757 = (805.7594438342468 - 881.8390512835393) / 805.7594438342468 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_9a07bbee-9d43-41e9-9865-eb4e9e6d3715.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_9a07bbee-9d43-41e9-9865-eb4e9e6d3715.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_baseline_9a07bbee-9d43-41e9-9865-eb4e9e6d3715.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeObjectProperty_Mo_compare_9a07bbee-9d43-41e9-9865-eb4e9e6d3715.log) #### System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToUtf8Bytes(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 882.47585323271 > 865.4721575107568. IsChangePoint: Marked as a change because one of 2/14/2023 2:39:38 AM, 2/24/2023 12:21:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -8.625708474035484 (T) = (0 -888.3687577336385) / Math.Sqrt((440.93248583183225 / (33)) + (125.06325699334288 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.06936293168188278 = (830.7457939807409 - 888.3687577336385) / 830.7457939807409 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_997ac249-129c-4eb1-af74-ae64acc96d3d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_997ac249-129c-4eb1-af74-ae64acc96d3d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__baseline_997ac249-129c-4eb1-af74-ae64acc96d3d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_LargeStructWithProperties__SerializeToUtf8Bytes_Mode__compare_997ac249-129c-4eb1-af74-ae64acc96d3d.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToWriter(Mode%3a%20SourceGen).html>)	273.10 ns	304.44 ns	1.11	0.01	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToString(Mode%3a%20SourceGen).html>)	391.29 ns	438.40 ns	1.12	0.06	False
[SerializeToStream - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToStream(Mode%3a%20Reflection).html>)	578.95 ns	643.00 ns	1.11	0.20	False
[SerializeObjectProperty - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeObjectProperty(Mode%3a%20Reflection).html>)	742.07 ns	787.82 ns	1.06	0.05	False
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	344.34 ns	379.30 ns	1.10	0.04	False
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToWriter(Mode%3a%20Reflection).html>)	410.29 ns	451.66 ns	1.10	0.07	False
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(ClassRecord).SerializeToString(Mode%3a%20Reflection).html>)	540.37 ns	580.38 ns	1.07	0.07	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ClassRecord&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 304.4395155750093 > 286.51073404508304. IsChangePoint: Marked as a change because one of 3/15/2023 5:33:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.188786184960046 (T) = (0 -308.3390393855911) / Math.Sqrt((19.575801449464294 / (33)) + (26.052216444597885 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.11779130214494149 = (275.84669767416875 - 308.3390393855911) / 275.84669767416875 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 438.404742164396 > 417.09181220504473. IsChangePoint: Marked as a change because one of 2/13/2023 6:54:14 PM, 3/15/2023 5:33:41 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.547291156772633 (T) = (0 -432.3985982446527) / Math.Sqrt((48.969291461862866 / (33)) + (71.10237229101433 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.08295444110643081 = (399.27681334671894 - 432.3985982446527) / 399.27681334671894 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToStream(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 643.0018216643333 > 611.5088421425794. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.949852283262093 (T) = (0 -656.0637549047842) / Math.Sqrt((296.3661974690614 / (33)) + (91.00068747336711 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.09341044739656817 = (600.0159925916978 - 656.0637549047842) / 600.0159925916978 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeObjectProperty(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 787.815135715381 > 778.2012041164198. IsChangePoint: Marked as a change because one of 3/7/2023 10:25:17 PM, 3/15/2023 9:07:40 PM, 4/12/2023 4:44:56 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.18825581460965 (T) = (0 -781.3952611717011) / Math.Sqrt((179.92480256315156 / (32)) + (31.4007691240807 / (5))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (5) - 2, .025) and -0.06683108928913596 = (732.4451537050444 - 781.3952611717011) / 732.4451537050444 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 379.30416383304294 > 363.0566364618191. IsChangePoint: Marked as a change because one of 3/20/2023 11:25:43 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.834283188371873 (T) = (0 -395.32327414963095) / Math.Sqrt((114.91423755105676 / (33)) + (193.81923622204735 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1190174546223738 = (353.2771294287252 - 395.32327414963095) / 353.2771294287252 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 451.6557827551563 > 423.95017534459305. IsChangePoint: Marked as a change because one of 3/27/2023 8:33:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.873247378326475 (T) = (0 -451.8702955103877) / Math.Sqrt((32.76867315220809 / (33)) + (13.364415117458194 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1177945442648995 = (404.25165593159454 - 451.8702955103877) / 404.25165593159454 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToString(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 580.3815334358186 > 560.8876008633517. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.791629675145413 (T) = (0 -591.116749758592) / Math.Sqrt((119.56280113357528 / (33)) + (230.04622956248411 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.09870162273661869 = (538.0139043448877 - 591.116749758592) / 538.0139043448877 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyFalse(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	6.45 μs	8.55 μs	1.33	0.09	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.552620839852835 > 6.7604031897888754. IsChangePoint: Marked as a change because one of 3/25/2023 10:49:06 AM, 4/10/2023 1:33:42 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.683099381331708 (T) = (0 -8683.530387149312) / Math.Sqrt((824857.1635042593 / (33)) + (140655.48393643877 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4925374243868265 = (5817.964926887334 - 8683.530387149312) / 5817.964926887334 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__baseline_efeca5d8-3e42-4309-8f50-11799e5d074d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__compare_efeca5d8-3e42-4309-8f50-11799e5d074d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__baseline_efeca5d8-3e42-4309-8f50-11799e5d074d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyFalse_Int32__Int32__Dictionary_Size__512__compare_efeca5d8-3e42-4309-8f50-11799e5d074d.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FormatterUInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value%3a%200).html>)	1.60 ns	9.64 ns	6.02	0.08	True				Trace	Trace
[FormatterUInt64 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value%3a%200).html>)	2.37 ns	14.96 ns	6.30	0.12	True				Trace	Trace
[FormatterInt32 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value%3a%204).html>)	1.61 ns	10.08 ns	6.28	0.46	True				Trace	Trace
[FormatterDecimal - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value%3a%20123456.789).html>)	50.19 ns	85.14 ns	1.70	0.02	True	521.243535775311	798.9530380392442	1.5327826307732737)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.636850079759702 > 1.6190477540618615. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -98.41153399265536 (T) = (0 -9.560282692146686) / Math.Sqrt((0.0026321656971890783 / (33)) + (0.026069194127207384 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.1007293375034966 = (1.5670720930653328 - 9.560282692146686) / 1.5670720930653328 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__baseline_34c151b9-54b8-4af8-abb3-215df3cd5ed4.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__compare_34c151b9-54b8-4af8-abb3-215df3cd5ed4.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__baseline_34c151b9-54b8-4af8-abb3-215df3cd5ed4.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt32_value__0__compare_34c151b9-54b8-4af8-abb3-215df3cd5ed4.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 14.96246400530081 > 1.9878033643880555. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -143.29317519880442 (T) = (0 -14.883421314475717) / Math.Sqrt((0.05992998883966135 / (33)) + (0.024297894421093216 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.90685061755734 = (2.1548781258771963 - 14.883421314475717) / 2.1548781258771963 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__baseline_3e103c2c-952d-4c35-97ec-ca3c3c297209.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__compare_3e103c2c-952d-4c35-97ec-ca3c3c297209.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__baseline_3e103c2c-952d-4c35-97ec-ca3c3c297209.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterUInt64_value__0__compare_3e103c2c-952d-4c35-97ec-ca3c3c297209.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.084444468460179 > 2.6386137862519417. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -57.08230468313368 (T) = (0 -10.183008006732459) / Math.Sqrt((0.2681942858399528 / (33)) + (0.047820172423379805 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -3.8634325858915823 = (2.0937903069269486 - 10.183008006732459) / 2.0937903069269486 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__baseline_b059cb5c-b5b3-48c7-be13-16fdf6e7ffdd.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__compare_b059cb5c-b5b3-48c7-be13-16fdf6e7ffdd.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__baseline_b059cb5c-b5b3-48c7-be13-16fdf6e7ffdd.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterInt32_value__4__compare_b059cb5c-b5b3-48c7-be13-16fdf6e7ffdd.log) #### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 85.13599578061465 > 52.590386485794475. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -175.96358428096318 (T) = (0 -85.0412475857315) / Math.Sqrt((0.5676762502126529 / (33)) + (0.08994683671345376 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.7013149085411007 = (49.98560064265554 - 85.0412475857315) / 49.98560064265554 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__baseline_8c7d5330-687f-4814-951b-efda7c4bffe2.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__compare_8c7d5330-687f-4814-951b-efda7c4bffe2.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__baseline_8c7d5330-687f-4814-951b-efda7c4bffe2.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Buffers_Text_Tests_Utf8FormatterTests_FormatterDecimal_value__123456_789__compare_8c7d5330-687f-4814-951b-efda7c4bffe2.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Deep

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	6.90 ms	7.65 ms	1.11	0.01	False				Trace	Trace
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	6.74 ms	7.64 ms	1.13	0.00	False	59763809.52380952	67118750	1.1230667946838349)	Trace	Trace
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>)	36.90 ms	41.10 ms	1.11	0.08	False	72596638.65546219	80016666.66666667	1.1022089748041826)	Trace	Trace
[WriteDeepUtf16 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>)	7.21 ms	7.75 ms	1.07	0.01	False				Trace	Trace
[WriteDeepUtf8 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>)	6.65 ms	7.62 ms	1.15	0.01	False	57726126.126126125	65075000	1.1273058555465385)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.645260833333333 > 7.211947840653154. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 3/14/2023 8:42:09 PM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.020560288140878 (T) = (0 -7632119.895833333) / Math.Sqrt((52073575485.53638 / (33)) + (925275378.2841406 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1471836867623015 = (6652918.781798125 - 7632119.895833333) / 6652918.781798125 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__baseline_963aa47a-5288-43b4-86e3-ffa8bbfb33ac.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__compare_963aa47a-5288-43b4-86e3-ffa8bbfb33ac.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__baseline_963aa47a-5288-43b4-86e3-ffa8bbfb33ac.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__True__compare_963aa47a-5288-43b4-86e3-ffa8bbfb33ac.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.640248095238095 > 7.280531209084084. IsChangePoint: Marked as a change because one of 2/20/2023 2:42:44 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.01313680530084 (T) = (0 -7832638.57936508) / Math.Sqrt((9931543728.867779 / (33)) + (46559286977.1404 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14382855412043022 = (6847738.28311022 - 7832638.57936508) / 6847738.28311022 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__baseline_17c826e7-c327-4f44-9f70-8a985a11d6be.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__compare_17c826e7-c327-4f44-9f70-8a985a11d6be.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__baseline_17c826e7-c327-4f44-9f70-8a985a11d6be.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__False__compare_17c826e7-c327-4f44-9f70-8a985a11d6be.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: True, SkipValidation: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 41.1021 > 38.69441225961539. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -4.0487888048844445 (T) = (0 -39469204.265873015) / Math.Sqrt((2153493810509.96 / (33)) + (1218628930909.244 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.06654193689393072 = (37006706.34744885 - 39469204.265873015) / 37006706.34744885 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__True__SkipValidation__False__baseline_6d240a20-66b7-4a86-b0c6-4df4954f44f9.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__True__SkipValidation__False__compare_6d240a20-66b7-4a86-b0c6-4df4954f44f9.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__True__SkipValidation__False__baseline_6d240a20-66b7-4a86-b0c6-4df4954f44f9.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__True__SkipValidation__False__compare_6d240a20-66b7-4a86-b0c6-4df4954f44f9.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.749772307692309 > 7.401376159722222. IsChangePoint: Marked as a change because one of 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 8:42:09 PM, 4/8/2023 3:09:32 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.74662449105437 (T) = (0 -7795911.936546093) / Math.Sqrt((38283863377.77079 / (33)) + (1810852612.1066694 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1327305777282335 = (6882406.187163511 - 7795911.936546093) / 6882406.187163511 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__baseline_fb7f012d-5c3b-4e2c-960e-11337c9c239f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__compare_fb7f012d-5c3b-4e2c-960e-11337c9c239f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__baseline_fb7f012d-5c3b-4e2c-960e-11337c9c239f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf16_Formatted__False__SkipValidation__False__compare_fb7f012d-5c3b-4e2c-960e-11337c9c239f.log) #### System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.619510833333333 > 6.902082710526316. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.877690891786063 (T) = (0 -7700493.831730769) / Math.Sqrt((5046535897.430735 / (33)) + (9533532854.265615 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.17594725490990762 = (6548332.673577884 - 7700493.831730769) / 6548332.673577884 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__baseline_8acf6452-ed59-4a82-9d37-07dd7e3f2e63.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__compare_8acf6452-ed59-4a82-9d37-07dd7e3f2e63.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__baseline_8acf6452-ed59-4a82-9d37-07dd7e3f2e63.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Deep_WriteDeepUtf8_Formatted__False__SkipValidation__True__compare_8acf6452-ed59-4a82-9d37-07dd7e3f2e63.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	1.19 μs	1.30 μs	1.09	0.03	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	3.12 ms	4.02 ms	1.29	0.00	True	29834599.156118147	36756666.666666664	1.2320147649488034)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	828.90 ns	944.51 ns	1.14	0.02	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	2.13 ms	3.17 ms	1.49	0.00	True				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	984.94 ns	1.07 μs	1.08	0.06	False				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	1.08 μs	1.22 μs	1.13	0.01	False				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	2.23 ms	3.24 ms	1.45	0.00	True				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	2.13 ms	3.18 ms	1.50	0.00	True				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	3.09 ms	3.96 ms	1.28	0.00	True	28826337.44855967	35717460.31746032	1.2390564837172877)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	769.95 ns	896.22 ns	1.16	0.01	True				Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	1.04 μs	1.16 μs	1.11	0.01	False	9958.00890464434	10793.517022887063	1.0839031302586049)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%2010).html>)	1.24 μs	1.35 μs	1.09	0.01	False				Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%2010).html>)	923.57 ns	1.02 μs	1.11	0.06	False	8772.249606684998	9611.253879497743	1.0956430004195699)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20True%2c%20SkipValidation%3a%20True%2c%20DataSize%3a%20100000).html>)	3.05 ms	3.94 ms	1.29	0.00	True	28851028.806584366	35717204.301075265	1.2379871976324084)	Trace	Trace
[WriteBasicUtf8 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted%3a%20True%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	3.15 ms	4.01 ms	1.27	0.00	True	29832067.510548525	36748633.87978142	1.2318500508483772)	Trace	Trace
[WriteBasicUtf16 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted%3a%20False%2c%20SkipValidation%3a%20False%2c%20DataSize%3a%20100000).html>)	2.21 ms	3.22 ms	1.45	0.00	True	20502380.95238095	27904385.96491228	1.3610314835980906)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.3013522405070814 > 1.2445279289391638. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -50.67731711225283 (T) = (0 -1303.9043028847339) / Math.Sqrt((161.1081299361411 / (33)) + (5.446904828882495 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.10756234138736145 = (1177.2739593614472 - 1303.9043028847339) / 1177.2739593614472 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_30202660-9fa9-4221-b5b8-2c014ea0f940.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_30202660-9fa9-4221-b5b8-2c014ea0f940.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_30202660-9fa9-4221-b5b8-2c014ea0f940.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_30202660-9fa9-4221-b5b8-2c014ea0f940.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.018615756823822 > 3.221112317073171. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -127.09552413106827 (T) = (0 -4021171.200372209) / Math.Sqrt((1420837181.7965393 / (33)) + (36586469.88092175 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.2959432624742201 = (3102891.39718584 - 4021171.200372209) / 3102891.39718584 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_947b4ecc-1cf0-40ae-84e2-949202d0fa78.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_947b4ecc-1cf0-40ae-84e2-949202d0fa78.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_947b4ecc-1cf0-40ae-84e2-949202d0fa78.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_947b4ecc-1cf0-40ae-84e2-949202d0fa78.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 944.5098704805871 > 868.7804052983106. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -46.94131660213171 (T) = (0 -943.7578298916271) / Math.Sqrt((100.54749026982695 / (32)) + (10.692622966524048 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.13629165454927758 = (830.5595012628856 - 943.7578298916271) / 830.5595012628856 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_b5b104b4-565d-4f24-a17d-92d1ff84332d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_b5b104b4-565d-4f24-a17d-92d1ff84332d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_b5b104b4-565d-4f24-a17d-92d1ff84332d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_b5b104b4-565d-4f24-a17d-92d1ff84332d.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.1666015189873424 > 2.2026112352941176. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -251.5633032624634 (T) = (0 -3168620.549822892) / Math.Sqrt((292591303.99915236 / (32)) + (33543630.970678102 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.4979018905921855 = (2115372.5552547364 - 3168620.549822892) / 2115372.5552547364 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_243d5c24-d5e4-4ac5-8039-e1544607879a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_243d5c24-d5e4-4ac5-8039-e1544607879a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_243d5c24-d5e4-4ac5-8039-e1544607879a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_243d5c24-d5e4-4ac5-8039-e1544607879a.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0665594249781511 > 1013.9053635819567. IsChangePoint: Marked as a change because one of 2/6/2023 2:52:08 AM, 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -6.119237076640634 (T) = (0 -1084.351153578224) / Math.Sqrt((465.8407393897672 / (32)) + (1208.5950928002505 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.1116400057087079 = (975.4517181908308 - 1084.351153578224) / 975.4517181908308 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_a2a115ad-7ae6-44fb-9e9b-d11da7cf00df.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_a2a115ad-7ae6-44fb-9e9b-d11da7cf00df.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_a2a115ad-7ae6-44fb-9e9b-d11da7cf00df.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_a2a115ad-7ae6-44fb-9e9b-d11da7cf00df.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.220269155955358 > 1.1276378243096057. IsChangePoint: Marked as a change because one of 2/8/2023 7:09:09 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.06177794473987 (T) = (0 -1213.7539209124507) / Math.Sqrt((107.03641596258407 / (33)) + (24.780491505327916 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.11915190011258973 = (1084.5300988993038 - 1213.7539209124507) / 1084.5300988993038 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_5faf7be8-433a-4954-8af8-aa77a12a5cf6.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_5faf7be8-433a-4954-8af8-aa77a12a5cf6.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_5faf7be8-433a-4954-8af8-aa77a12a5cf6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_5faf7be8-433a-4954-8af8-aa77a12a5cf6.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.235314112554112 > 2.3084862192982456. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -134.24855100499525 (T) = (0 -3236595.816604031) / Math.Sqrt((200422504.74082273 / (33)) + (212532979.42868587 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.46877060395494247 = (2203608.792202734 - 3236595.816604031) / 2203608.792202734 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_a8cb296e-34f7-40f6-8b82-5378b64f06c5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_a8cb296e-34f7-40f6-8b82-5378b64f06c5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___baseline_a8cb296e-34f7-40f6-8b82-5378b64f06c5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__False__DataSize___compare_a8cb296e-34f7-40f6-8b82-5378b64f06c5.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.1847716455696204 > 2.215625219074918. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -186.56901483717806 (T) = (0 -3170453.734177215) / Math.Sqrt((208029765.3218987 / (33)) + (102698211.02922113 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.49873851717781365 = (2115414.8624586696 - 3170453.734177215) / 2115414.8624586696 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_8e75b885-f099-43cf-ac81-58da0933571e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_8e75b885-f099-43cf-ac81-58da0933571e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_8e75b885-f099-43cf-ac81-58da0933571e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_8e75b885-f099-43cf-ac81-58da0933571e.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.9594003174603185 > 3.1216106666666663. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -79.87204024972829 (T) = (0 -3953892.195767196) / Math.Sqrt((3649196543.5548053 / (33)) + (85715695.79332973 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.302252242936686 = (3036195.3432699363 - 3953892.195767196) / 3036195.3432699363 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_98d9b2da-bb33-4430-8117-f8b6f7f60b7f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_98d9b2da-bb33-4430-8117-f8b6f7f60b7f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_98d9b2da-bb33-4430-8117-f8b6f7f60b7f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_98d9b2da-bb33-4430-8117-f8b6f7f60b7f.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 896.2231256416676 > 811.5050163704236. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -44.16484160542458 (T) = (0 -900.6954684787792) / Math.Sqrt((54.92470636279264 / (33)) + (25.86871330718626 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1625545216680858 = (774.7554645320381 - 900.6954684787792) / 774.7554645320381 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_b6ed4c3f-5ca2-4cca-a5b1-ae662666b694.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_b6ed4c3f-5ca2-4cca-a5b1-ae662666b694.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_baseline_b6ed4c3f-5ca2-4cca-a5b1-ae662666b694.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__False__SkipValidation__True__DataSize__1_compare_b6ed4c3f-5ca2-4cca-a5b1-ae662666b694.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.1608347353654733 > 1.075880788207805. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -31.580955289776192 (T) = (0 -1154.3437377500652) / Math.Sqrt((213.41085718979775 / (33)) + (27.987390424556697 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1115882831615803 = (1038.4633908400688 - 1154.3437377500652) / 1038.4633908400688 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_88069e96-74ef-4575-aa77-7d7b2992febc.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_88069e96-74ef-4575-aa77-7d7b2992febc.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_baseline_88069e96-74ef-4575-aa77-7d7b2992febc.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__True__DataSize__10_compare_88069e96-74ef-4575-aa77-7d7b2992febc.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: False, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.3481521990959002 > 1.2786554017316292. IsChangePoint: Marked as a change because one of 2/6/2023 2:52:08 AM, 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -28.09429207660544 (T) = (0 -1354.196090767787) / Math.Sqrt((326.5962018377151 / (33)) + (60.35222127811668 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.11569688074691536 = (1213.7670312936662 - 1354.196090767787) / 1213.7670312936662 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_caf2b14f-f1af-4b75-bacd-91eaed197b0a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_caf2b14f-f1af-4b75-bacd-91eaed197b0a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___baseline_caf2b14f-f1af-4b75-bacd-91eaed197b0a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__False__DataSize___compare_caf2b14f-f1af-4b75-bacd-91eaed197b0a.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: True, DataSize: 10) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0247650862602922 > 967.2011586902821. IsChangePoint: Marked as a change because one of 2/9/2023 10:24:28 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.820772293562584 (T) = (0 -1035.4466331206613) / Math.Sqrt((119.17013371484538 / (33)) + (170.04562733907923 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.12400636617963422 = (921.2106481567564 - 1035.4466331206613) / 921.2106481567564 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_59d4b91b-913e-40c4-ab6b-1dbcb11b3493.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_59d4b91b-913e-40c4-ab6b-1dbcb11b3493.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___baseline_59d4b91b-913e-40c4-ab6b-1dbcb11b3493.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__True__DataSize___compare_59d4b91b-913e-40c4-ab6b-1dbcb11b3493.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: True, SkipValidation: True, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.942589523809524 > 3.134351916666667. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -119.36107243388322 (T) = (0 -3953817.6862026867) / Math.Sqrt((1310953903.6135967 / (33)) + (87176182.72518718 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3102465715192335 = (3017613.4569985764 - 3953817.6862026867) / 3017613.4569985764 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_ce1be14c-c837-40ef-afc0-7fbe1b9d6f60.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_ce1be14c-c837-40ef-afc0-7fbe1b9d6f60.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_baseline_ce1be14c-c837-40ef-afc0-7fbe1b9d6f60.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__True__SkipValidation__True__DataSize__1_compare_ce1be14c-c837-40ef-afc0-7fbe1b9d6f60.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.012737442396314 > 3.2457706927825263. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -96.06123174493065 (T) = (0 -4025714.578459175) / Math.Sqrt((975040207.6878403 / (33)) + (249368284.6587017 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.29657449804913055 = (3104884.8982579866 - 4025714.578459175) / 3104884.8982579866 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_3fdb4117-9457-433a-a9d5-efe856b5db53.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_3fdb4117-9457-433a-a9d5-efe856b5db53.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_baseline_3fdb4117-9457-433a-a9d5-efe856b5db53.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf8_Formatted__True__SkipValidation__False__DataSize__1_compare_3fdb4117-9457-433a-a9d5-efe856b5db53.log) #### System.Text.Json.Tests.Perf_Basic.WriteBasicUtf16(Formatted: False, SkipValidation: False, DataSize: 100000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 3.2153797435897444 > 2.2988547105263155. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -102.79065259015209 (T) = (0 -3223885.182235347) / Math.Sqrt((452656027.34381205 / (33)) + (335750267.72911805 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.46002323627029784 = (2208105.393220263 - 3223885.182235347) / 2208105.393220263 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_5f1eb666-54e1-4dff-a5a1-d6b863e7cf8c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.blob.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_5f1eb666-54e1-4dff-a5a1-d6b863e7cf8c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__baseline_5f1eb666-54e1-4dff-a5a1-d6b863e7cf8c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Tests_Perf_Basic_WriteBasicUtf16_Formatted__False__SkipValidation__False__DataSize__compare_5f1eb666-54e1-4dff-a5a1-d6b863e7cf8c.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Tests.Perf_Dictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Clone - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.Perf_Dictionary.Clone(Items%3a%203000).html>)	16.64 μs	25.46 μs	1.53	0.01	True	133466.94378463976	228760.162601626	1.7139836735210625)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.Perf_Dictionary.Clone(Items: 3000) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 25.45934456168831 > 17.362161790922844. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.598084552714226 (T) = (0 -26484.30689405448) / Math.Sqrt((17683.318239238426 / (32)) + (515941.99373983126 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.6001278427959106 = (16551.369325452353 - 26484.30689405448) / 16551.369325452353 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_Perf_Dictionary_Clone_Items__3000__baseline_875bb6fe-7130-43b8-909b-046d996064ee.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_Perf_Dictionary_Clone_Items__3000__compare_875bb6fe-7130-43b8-909b-046d996064ee.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_Perf_Dictionary_Clone_Items__3000__baseline_875bb6fe-7130-43b8-909b-046d996064ee.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_Perf_Dictionary_Clone_Items__3000__compare_875bb6fe-7130-43b8-909b-046d996064ee.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt32.TryFormat(value%3a%204294967295).html>)	7.07 ns	8.11 ns	1.15	0.05	False	101.7846736338764	111.32459447745805	1.093726496367195)	Trace	Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt32.ToString(value%3a%200).html>)	2.93 ns	4.09 ns	1.39	0.09	False	17.39284137802652	18.160738478677008	1.0441501813280847)	Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt32*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt32.TryFormat(value: 4294967295) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.106561061555315 > 7.428329727857425. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -39.735780440682404 (T) = (0 -8.082490756440329) / Math.Sqrt((0.013543096448008416 / (32)) + (0.0006138410902900279 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.13386466793813726 = (7.128267583412612 - 8.082490756440329) / 7.128267583412612 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt32_TryFormat_value__4294967295__baseline_a388f7e8-1058-4c83-8a4f-ab395eb1a557.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt32_TryFormat_value__4294967295__compare_a388f7e8-1058-4c83-8a4f-ab395eb1a557.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt32_TryFormat_value__4294967295__baseline_a388f7e8-1058-4c83-8a4f-ab395eb1a557.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt32_TryFormat_value__4294967295__compare_a388f7e8-1058-4c83-8a4f-ab395eb1a557.log) #### System.Tests.Perf_UInt32.ToString(value: 0) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.090646181827028 > 3.0842319306070882. IsChangePoint: Marked as a change because one of 2/13/2023 6:54:14 PM, 2/20/2023 10:31:48 AM, 3/2/2023 7:59:08 PM, 3/17/2023 5:15:23 PM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -18.61836569205457 (T) = (0 -4.116777261286332) / Math.Sqrt((0.09059730327942209 / (33)) + (0.00042351907902836336 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3183769659099603 = (3.1226101242180615 - 4.116777261286332) / 3.1226101242180615 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt32_ToString_value__0__baseline_b0e962f6-fcbf-4e93-8b52-08ea238a85a3.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt32_ToString_value__0__compare_b0e962f6-fcbf-4e93-8b52-08ea238a85a3.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt32_ToString_value__0__baseline_b0e962f6-fcbf-4e93-8b52-08ea238a85a3.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt32_ToString_value__0__compare_b0e962f6-fcbf-4e93-8b52-08ea238a85a3.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).Dictionary(Size%3a%20512).html>)	8.02 μs	11.66 μs	1.45	0.14	False				Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.AddGivenSize(Int32).IDictionary(Size%3a%20512).html>)	8.48 μs	12.06 μs	1.42	0.13	False	53837.5350140056	71345.43761638734	1.325198815247153)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.662917289486796 > 8.429764646581189. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -86.67054526722596 (T) = (0 -11624.76344446126) / Math.Sqrt((45660.25263835956 / (33)) + (674.1487191715453 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.415903085449965 = (8210.14062609164 - 11624.76344446126) / 8210.14062609164 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_AddGivenSize_Int32__Dictionary_Size__512__baseline_5063cacf-5230-41e2-8d9f-36c17498886c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_AddGivenSize_Int32__Dictionary_Size__512__compare_5063cacf-5230-41e2-8d9f-36c17498886c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_AddGivenSize_Int32__Dictionary_Size__512__baseline_5063cacf-5230-41e2-8d9f-36c17498886c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_AddGivenSize_Int32__Dictionary_Size__512__compare_5063cacf-5230-41e2-8d9f-36c17498886c.log) #### System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.062006815843622 > 8.9312948063403. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -101.47786974812246 (T) = (0 -11989.463910945487) / Math.Sqrt((17536.66085840493 / (33)) + (2603.8947926734145 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4105152670876138 = (8500.059652456612 - 11989.463910945487) / 8500.059652456612 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_AddGivenSize_Int32__IDictionary_Size__512__baseline_77384bbe-e0fa-4c69-a3a4-8324dfe216a0.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_AddGivenSize_Int32__IDictionary_Size__512__compare_77384bbe-e0fa-4c69-a3a4-8324dfe216a0.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_AddGivenSize_Int32__IDictionary_Size__512__baseline_77384bbe-e0fa-4c69-a3a4-8324dfe216a0.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_AddGivenSize_Int32__IDictionary_Size__512__compare_77384bbe-e0fa-4c69-a3a4-8324dfe216a0.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).IDictionary(Size%3a%20512).html>)	13.71 μs	20.04 μs	1.46	0.04	True	83950.93062605754	125336.92722371967	1.4929784135688464)	Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).Dictionary(Size%3a%20512).html>)	14.51 μs	19.39 μs	1.34	0.20	False	80905.72867485048	122122.10572302317	1.5094370661169854)	Trace	Trace
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndClear(Int32).HashSet(Size%3a%20512).html>)	10.26 μs	10.88 μs	1.06	0.02	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.038781062553557 > 14.34937923140137. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -70.86365574563868 (T) = (0 -20153.26171069021) / Math.Sqrt((32646.289718293126 / (33)) + (28368.35534511428 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4621961900154951 = (13782.871168934344 - 20153.26171069021) / 13782.871168934344 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__baseline_673a2e9e-72aa-4081-9e75-2c7ed4797b1c.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__compare_673a2e9e-72aa-4081-9e75-2c7ed4797b1c.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__baseline_673a2e9e-72aa-4081-9e75-2c7ed4797b1c.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__IDictionary_Size__512__compare_673a2e9e-72aa-4081-9e75-2c7ed4797b1c.log) #### System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.391185024752478 > 15.249977231592592. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.13342732552967 (T) = (0 -19257.586597990856) / Math.Sqrt((621422.7631320591 / (33)) + (13846.61407049544 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.40430018767533143 = (13713.297745740338 - 19257.586597990856) / 13713.297745740338 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__baseline_6fe124a2-05d9-4fd3-b0c5-d71b2ac80af7.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__compare_6fe124a2-05d9-4fd3-b0c5-d71b2ac80af7.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__baseline_6fe124a2-05d9-4fd3-b0c5-d71b2ac80af7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__Dictionary_Size__512__compare_6fe124a2-05d9-4fd3-b0c5-d71b2ac80af7.log) #### System.Collections.CreateAddAndClear<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.878549426095104 > 10.762954040445914. IsChangePoint: Marked as a change because one of 2/16/2023 6:27:39 AM, 2/20/2023 10:31:48 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -17.20334848164512 (T) = (0 -10866.8222292284) / Math.Sqrt((9913.314941632247 / (33)) + (3810.940287273696 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.059368637466611425 = (10257.828903841695 - 10866.8222292284) / 10257.828903841695 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__HashSet_Size__512__baseline_d52c4b7c-b96d-4134-8998-79f78b70fa9f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndClear_Int32__HashSet_Size__512__compare_d52c4b7c-b96d-4134-8998-79f78b70fa9f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__HashSet_Size__512__baseline_d52c4b7c-b96d-4134-8998-79f78b70fa9f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndClear_Int32__HashSet_Size__512__compare_d52c4b7c-b96d-4134-8998-79f78b70fa9f.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToString(Mode%3a%20SourceGen).html>)	207.63 ns	231.16 ns	1.11	0.10	False	2108.5728401426304	2209.452249688778	1.0478425063747496)	Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToWriter(Mode%3a%20SourceGen).html>)	117.18 ns	134.13 ns	1.14	0.05	False				Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToWriter(Mode%3a%20Reflection).html>)	189.33 ns	201.51 ns	1.06	0.04	False	1725.022195788403	1809.3618743068862	1.048891938158475)	Trace	Trace
[SerializeToUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(SimpleStructWithProperties).SerializeToUtf8Bytes(Mode%3a%20SourceGen).html>)	192.32 ns	209.10 ns	1.09	0.10	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;SimpleStructWithProperties&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToString(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 231.16214608972612 > 221.82233985546338. IsChangePoint: Marked as a change because one of 3/24/2023 7:28:10 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.04036322994264 (T) = (0 -228.59376492594367) / Math.Sqrt((19.072678843017883 / (33)) + (5.4715132585817585 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.07223761368384184 = (213.19319711288028 - 228.59376492594367) / 213.19319711288028 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_baseline_677a9f60-73ae-4e21-bdcf-81df0b465bf7.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_compare_677a9f60-73ae-4e21-bdcf-81df0b465bf7.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_baseline_677a9f60-73ae-4e21-bdcf-81df0b465bf7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToString_Mode__S_compare_677a9f60-73ae-4e21-bdcf-81df0b465bf7.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 134.12623081347124 > 122.70720952794665. IsChangePoint: Marked as a change because one of 2/20/2023 8:11:49 PM, 2/28/2023 5:58:27 PM, 3/21/2023 2:16:57 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -38.93054411764291 (T) = (0 -134.27043499277175) / Math.Sqrt((0.8456567796852295 / (33)) + (0.6532166632605212 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14419900130999017 = (117.34884826769287 - 134.27043499277175) / 117.34884826769287 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_baseline_45fbceda-cda3-4280-8704-85f8471e1f9a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_compare_45fbceda-cda3-4280-8704-85f8471e1f9a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_baseline_45fbceda-cda3-4280-8704-85f8471e1f9a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__S_compare_45fbceda-cda3-4280-8704-85f8471e1f9a.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 201.50847085860704 > 199.10414476075303. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -9.674862603950524 (T) = (0 -202.858832450776) / Math.Sqrt((8.201294491961622 / (33)) + (4.689373389315734 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.06027631931274629 = (191.3263823361308 - 202.858832450776) / 191.3263823361308 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_baseline_84cacb8c-a74f-409d-a09e-3291eb3b5a37.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_compare_84cacb8c-a74f-409d-a09e-3291eb3b5a37.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_baseline_84cacb8c-a74f-409d-a09e-3291eb3b5a37.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToWriter_Mode__R_compare_84cacb8c-a74f-409d-a09e-3291eb3b5a37.log) #### System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 209.10265805871046 > 198.6562922177885. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -22.36443964784083 (T) = (0 -209.84964617039043) / Math.Sqrt((19.692367575508076 / (33)) + (0.4671354673482598 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.09892889081476218 = (190.9583485559332 - 209.84964617039043) / 190.9583485559332 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_baseline_33833760-ce5e-4abb-a9a8-dac026bfdcab.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_compare_33833760-ce5e-4abb-a9a8-dac026bfdcab.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_baseline_33833760-ce5e-4abb-a9a8-dac026bfdcab.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_SimpleStructWithProperties__SerializeToUtf8Bytes_Mode_compare_33833760-ce5e-4abb-a9a8-dac026bfdcab.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).FrozenDictionary(Size%3a%20512).html>)	6.36 μs	9.17 μs	1.44	0.03	True	42472.11895910781	58387.11329645564	1.374716278052216)	Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	7.18 μs	8.23 μs	1.15	0.48	False				Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryGetValueTrue(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	3.93 μs	7.79 μs	1.98	0.07	True	36622.43353202763	52619.28184948352	1.4368046242330148)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryGetValueTrue<Int32, Int32>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.166580875265089 > 6.670117349151122. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -41.027405296570315 (T) = (0 -9259.85651283212) / Math.Sqrt((42977.536916564924 / (33)) + (14456.147537936784 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.450674190339236 = (6383.140042401064 - 9259.85651283212) / 6383.140042401064 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__baseline_92f24d24-4f29-4f9b-82cd-10265bb7a812.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__compare_92f24d24-4f29-4f9b-82cd-10265bb7a812.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__baseline_92f24d24-4f29-4f9b-82cd-10265bb7a812.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__FrozenDictionary_Size__512__compare_92f24d24-4f29-4f9b-82cd-10265bb7a812.log) #### System.Collections.TryGetValueTrue<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.22864045420279 > 6.675439009232954. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.798923855744473 (T) = (0 -8254.411324371087) / Math.Sqrt((187680.81899298227 / (33)) + (9017.233018276751 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.22154315281150588 = (6757.36367182176 - 8254.411324371087) / 6757.36367182176 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__baseline_16d62435-e1bc-498a-bc1d-27ac614267f5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__compare_16d62435-e1bc-498a-bc1d-27ac614267f5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__baseline_16d62435-e1bc-498a-bc1d-27ac614267f5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__IDictionary_Size__512__compare_16d62435-e1bc-498a-bc1d-27ac614267f5.log) #### System.Collections.TryGetValueTrue<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.785362903225806 > 4.134661346351885. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.56305365449812 (T) = (0 -7953.318249820513) / Math.Sqrt((89688.00934509552 / (33)) + (199852.6930547733 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.9156729532946818 = (4151.709839689468 - 7953.318249820513) / 4151.709839689468 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__baseline_ac3e39ab-6e4f-473d-bad1-17a259cd85a1.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__compare_ac3e39ab-6e4f-473d-bad1-17a259cd85a1.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__baseline_ac3e39ab-6e4f-473d-bad1-17a259cd85a1.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryGetValueTrue_Int32__Int32__Dictionary_Size__512__compare_ac3e39ab-6e4f-473d-bad1-17a259cd85a1.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline ETL	Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.TryFormat(value%3a%2012345).html>)	9.16 ns	10.49 ns	1.15	0.02	False	Trace	Trace
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.ToString(value%3a%2012345).html>)	11.73 ns	12.82 ns	1.09	0.06	False	Trace	Trace
[Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_UInt64.Parse(value%3a%20%220%22).html>)	0.33 ns	9.71 ns	29.11	0.38	False	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

graph graph graph graph graph graph graph graph graph graph graph Test Report

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_UInt64.TryFormat(value: 12345) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 10.492131248039042 > 9.44385453862011. IsChangePoint: Marked as a change because one of 3/20/2023 8:31:51 AM, 3/24/2023 11:37:29 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -37.52168630687591 (T) = (0 -10.537753250782293) / Math.Sqrt((0.012347234105088907 / (33)) + (0.004829921226275915 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1649690094598298 = (9.045522383182034 - 10.537753250782293) / 9.045522383182034 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__12345__baseline_193ae3ab-ce20-4b2b-bb50-4fea93680811.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_TryFormat_value__12345__compare_193ae3ab-ce20-4b2b-bb50-4fea93680811.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__12345__baseline_193ae3ab-ce20-4b2b-bb50-4fea93680811.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_TryFormat_value__12345__compare_193ae3ab-ce20-4b2b-bb50-4fea93680811.log) #### System.Tests.Perf_UInt64.ToString(value: 12345) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.817492036107565 > 12.41219695696475. IsChangePoint: Marked as a change because one of 2/8/2023 3:55:57 PM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -25.829909405652778 (T) = (0 -12.79279485280147) / Math.Sqrt((0.01328859219315331 / (33)) + (0.0037733138092144046 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.08000315401052119 = (11.84514582693232 - 12.79279485280147) / 11.84514582693232 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_ToString_value__12345__baseline_9c860f70-45ec-47d6-868b-db45e3a9ec0d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_ToString_value__12345__compare_9c860f70-45ec-47d6-868b-db45e3a9ec0d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_ToString_value__12345__baseline_9c860f70-45ec-47d6-868b-db45e3a9ec0d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_ToString_value__12345__compare_9c860f70-45ec-47d6-868b-db45e3a9ec0d.log) #### System.Tests.Perf_UInt64.Parse(value: "0") ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.71002472782243 > 0.4304810368940388. IsChangePoint: Marked as a change because one of 4/7/2023 2:04:47 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.955350810347737 (T) = (0 -9.694498174703646) / Math.Sqrt((9.757473612833738 / (33)) + (0.0008771285615200288 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -5.2172991559451765 = (1.559278061348144 - 9.694498174703646) / 1.559278061348144 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_Parse_value___0___baseline_1d355bb6-18dc-4a6c-9b71-5dfd21150f87.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_UInt64_Parse_value___0___compare_1d355bb6-18dc-4a6c-9b71-5dfd21150f87.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___baseline_1d355bb6-18dc-4a6c-9b71-5dfd21150f87.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_UInt64_Parse_value___0___compare_1d355bb6-18dc-4a6c-9b71-5dfd21150f87.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Tests.DictionarySequentialKeys

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryGetValue_17_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue.html>)	6.38 ns	9.53 ns	1.49	0.00	True				Trace	Trace
[ContainsValue_17_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int.html>)	6.35 ns	9.24 ns	1.46	0.09	True	60.16213113856163	91.10058213221345	1.514251247556313)	Trace	Trace
[ContainsValue_3k_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int.html>)	6.24 ns	8.58 ns	1.37	0.04	True	59.77433060766394	90.66256830601093	1.5167475299905184)	Trace	Trace
[TryGetValue_3k_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue.html>)	6.36 ns	9.30 ns	1.46	0.08	True	59.53203658755843	90.52703580040809	1.5206440261331038)	Trace	Trace
[TryGetValue_3k_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int.html>)	6.24 ns	8.41 ns	1.35	0.02	True				Trace	Trace
[ContainsKey_17_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue.html>)	6.29 ns	9.98 ns	1.59	0.01	True	60.201632233941254	91.38831411961769	1.5180371483033246)	Trace	Trace
[ContainsKey_3k_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue.html>)	6.27 ns	9.18 ns	1.47	0.23	False	59.49856646888917	90.60908365575885	1.5228784327625249)	Trace	Trace
[TryGetValue_17_Int_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int.html>)	6.39 ns	9.24 ns	1.45	0.07	True				Trace	Trace
[TryGetValue_3k_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue.html>)	6.75 ns	8.55 ns	1.27	0.26	True	59.60240313217227	90.66564474173171	1.5211743147449046)	Trace	Trace
[ContainsKey_3k_Int_32ByteRefsValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue.html>)	6.56 ns	9.03 ns	1.38	0.09	True	59.52508960573477	90.66499721758487	1.5231391975737574)	Trace	Trace
[ContainsKey_17_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteValue.html>)	6.35 ns	9.58 ns	1.51	0.03	True				Trace	Trace
[TryGetValue_17_Int_32ByteValue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue.html>)	6.38 ns	9.52 ns	1.49	0.01	True	59.69632704729931	91.38236483665054	1.530787057707007)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.DictionarySequentialKeys*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.53159348745028 > 6.700049962105608. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -54.00938508416093 (T) = (0 -9.438807123951442) / Math.Sqrt((0.0019480101312103655 / (33)) + (0.012872069469368155 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4871259619566618 = (6.347012536538926 - 9.438807123951442) / 6.347012536538926 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_baseline_5a40e746-4bac-4210-a247-2ecadc031319.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_compare_5a40e746-4bac-4210-a247-2ecadc031319.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_baseline_5a40e746-4bac-4210-a247-2ecadc031319.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteRefsValue_compare_5a40e746-4bac-4210-a247-2ecadc031319.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.240657010798655 > 6.718664940171587. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -52.67746065061208 (T) = (0 -9.24640510116281) / Math.Sqrt((0.09357165193276813 / (33)) + (0.00023228940308206718 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4418714994095004 = (6.412780268525701 - 9.24640510116281) / 6.412780268525701 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_baseline_2d653e73-2703-45d7-91df-dfbb068834ec.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_compare_2d653e73-2703-45d7-91df-dfbb068834ec.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_baseline_2d653e73-2703-45d7-91df-dfbb068834ec.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_17_Int_Int_compare_2d653e73-2703-45d7-91df-dfbb068834ec.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.578071116685244 > 6.5599333539605444. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -33.37607535637836 (T) = (0 -8.61439991692317) / Math.Sqrt((0.0006148737083844026 / (33)) + (0.01992002159696708 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3772734620723966 = (6.25467647068506 - 8.61439991692317) / 6.25467647068506 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_baseline_b2c970a6-c707-4771-9691-73cdf7f58315.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_compare_b2c970a6-c707-4771-9691-73cdf7f58315.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_baseline_b2c970a6-c707-4771-9691-73cdf7f58315.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsValue_3k_Int_Int_compare_b2c970a6-c707-4771-9691-73cdf7f58315.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.296663711583925 > 6.639930977571016. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.23500011491484 (T) = (0 -9.032509736201947) / Math.Sqrt((0.014951719796566412 / (33)) + (0.10408248105204952 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4133271090592378 = (6.390954845700452 - 9.032509736201947) / 6.390954845700452 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_baseline_d3d70c25-88f6-4ad8-9354-4140104b4c5a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_compare_d3d70c25-88f6-4ad8-9354-4140104b4c5a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_baseline_d3d70c25-88f6-4ad8-9354-4140104b4c5a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteRefsValue_compare_d3d70c25-88f6-4ad8-9354-4140104b4c5a.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.412370086160472 > 6.557098906952284. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -11.158667208623395 (T) = (0 -8.636456418398593) / Math.Sqrt((0.001399070165496454 / (33)) + (0.18130247097297358 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.37969480122864463 = (6.259686135446523 - 8.636456418398593) / 6.259686135446523 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_baseline_337a111f-6f0b-408e-82c2-87c68f0d4799.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_compare_337a111f-6f0b-408e-82c2-87c68f0d4799.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_baseline_337a111f-6f0b-408e-82c2-87c68f0d4799.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_Int_compare_337a111f-6f0b-408e-82c2-87c68f0d4799.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.976659972786619 > 6.6056348763666906. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -23.625765221508367 (T) = (0 -9.680979053497012) / Math.Sqrt((0.0020365072183284 / (33)) + (0.07933413587914802 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.5249111601230595 = (6.348552825015565 - 9.680979053497012) / 6.348552825015565 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_baseline_c983bf31-55fb-481e-a265-e9cb1009a191.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_compare_c983bf31-55fb-481e-a265-e9cb1009a191.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_baseline_c983bf31-55fb-481e-a265-e9cb1009a191.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteRefsValue_compare_c983bf31-55fb-481e-a265-e9cb1009a191.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.182725178128871 > 6.759160300050224. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -12.185723273579 (T) = (0 -8.925252921127967) / Math.Sqrt((0.029691444522109964 / (33)) + (0.158216872623287 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3785626965673659 = (6.474317739303356 - 8.925252921127967) / 6.474317739303356 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_baseline_bc949452-ebba-46cf-a437-4c4a5ec758a5.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_compare_bc949452-ebba-46cf-a437-4c4a5ec758a5.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_baseline_bc949452-ebba-46cf-a437-4c4a5ec758a5.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteValue_compare_bc949452-ebba-46cf-a437-4c4a5ec758a5.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.241661467868017 > 6.743165760282477. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -115.3380331044902 (T) = (0 -9.244401382252402) / Math.Sqrt((0.020343761876532362 / (33)) + (1.1710279957855875E-05 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.45035575088387036 = (6.373885425433528 - 9.244401382252402) / 6.373885425433528 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_baseline_fbf97723-b428-42c5-aaf7-0f04930e2f83.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_compare_fbf97723-b428-42c5-aaf7-0f04930e2f83.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_baseline_fbf97723-b428-42c5-aaf7-0f04930e2f83.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_Int_compare_fbf97723-b428-42c5-aaf7-0f04930e2f83.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.549313809198543 > 6.887096901260506. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.617991735642462 (T) = (0 -9.28844950913451) / Math.Sqrt((0.04116309934101257 / (33)) + (0.27255408753886806 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4308538978513545 = (6.491542933267006 - 9.28844950913451) / 6.491542933267006 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_baseline_d58f8c87-3718-4c95-b005-6a40e1adc0bd.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_compare_d58f8c87-3718-4c95-b005-6a40e1adc0bd.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_baseline_d58f8c87-3718-4c95-b005-6a40e1adc0bd.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_3k_Int_32ByteValue_compare_d58f8c87-3718-4c95-b005-6a40e1adc0bd.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.028154151812242 > 6.6843286880256505. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -19.784145501341747 (T) = (0 -8.693848167717597) / Math.Sqrt((0.015437132063227103 / (33)) + (0.05098908348698169 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3542818668659958 = (6.419526378091748 - 8.693848167717597) / 6.419526378091748 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_baseline_69d02069-f9f1-4477-b318-0c6e5ecfa504.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_compare_69d02069-f9f1-4477-b318-0c6e5ecfa504.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_baseline_69d02069-f9f1-4477-b318-0c6e5ecfa504.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_3k_Int_32ByteRefsValue_compare_69d02069-f9f1-4477-b318-0c6e5ecfa504.log) #### System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.582125704627353 > 6.649628044383142. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -36.773882377857646 (T) = (0 -9.448583802674191) / Math.Sqrt((0.0895237570316342 / (32)) + (0.016299692509746083 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.4763412188136698 = (6.400000001535353 - 9.448583802674191) / 6.400000001535353 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteValue_baseline_4f1a98aa-9b1a-4294-9ad4-c396c9b5b337.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteValue_compare_4f1a98aa-9b1a-4294-9ad4-c396c9b5b337.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteValue_baseline_4f1a98aa-9b1a-4294-9ad4-c396c9b5b337.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_ContainsKey_17_Int_32ByteValue_compare_4f1a98aa-9b1a-4294-9ad4-c396c9b5b337.log) #### System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 9.522489032887298 > 6.696748568806835. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -65.80152370851509 (T) = (0 -9.442388777954259) / Math.Sqrt((0.001022961988312367 / (33)) + (0.008766276848071772 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4892808395069649 = (6.340233841375557 - 9.442388777954259) / 6.340233841375557 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_baseline_0bce8021-2d22-4911-903a-c16d7023f6c9.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_compare_0bce8021-2d22-4911-903a-c16d7023f6c9.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_baseline_0bce8021-2d22-4911-903a-c16d7023f6c9.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_Tests_DictionarySequentialKeys_TryGetValue_17_Int_32ByteValue_compare_0bce8021-2d22-4911-903a-c16d7023f6c9.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryAddDefaultSize(Int32).Dictionary(Count%3a%20512).html>)	13.81 μs	19.31 μs	1.40	0.20	False	80822.64957264956	122328.36787564767	1.5135406785407302)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 19.31204672029703 > 14.41667113109093. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -57.75108464625162 (T) = (0 -19243.118765887324) / Math.Sqrt((221719.46590289424 / (33)) + (10573.715167327415 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.40921415838832587 = (13655.212482320698 - 19243.118765887324) / 13655.212482320698 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__baseline_d4e3d7f3-c6d9-4a35-b3b7-316f3dacd00e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__compare_d4e3d7f3-c6d9-4a35-b3b7-316f3dacd00e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__baseline_d4e3d7f3-c6d9-4a35-b3b7-316f3dacd00e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddDefaultSize_Int32__Dictionary_Count__512__compare_d4e3d7f3-c6d9-4a35-b3b7-316f3dacd00e.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Append_Primitives - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Tests.Perf_StringBuilder.Append_Primitives.html>)	1.62 μs	1.72 μs	1.06	0.00	False	12238.74884283985	12902.246508803886	1.0542128672206725)	Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Tests.Perf_StringBuilder.Append_Primitives ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.7165302184644857 > 1.6995403709492636. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -21.165763863792748 (T) = (0 -1715.3484716138496) / Math.Sqrt((153.1911475055253 / (32)) + (53.68615292311974 / (4))) is less than -2.0322445093148245 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (4) - 2, .025) and -0.05557924379129614 = (1625.0305050077318 - 1715.3484716138496) / 1625.0305050077318 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Tests_Perf_StringBuilder_Append_Primitives_baseline_c429f055-0718-4ae8-b84c-cbacffdba92e.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Tests_Perf_StringBuilder_Append_Primitives_compare_c429f055-0718-4ae8-b84c-cbacffdba92e.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Tests_Perf_StringBuilder_Append_Primitives_baseline_c429f055-0718-4ae8-b84c-cbacffdba92e.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Tests_Perf_StringBuilder_Append_Primitives_compare_c429f055-0718-4ae8-b84c-cbacffdba92e.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryAddGiventSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.TryAddGiventSize(Int32).Dictionary(Count%3a%20512).html>)	8.02 μs	11.62 μs	1.45	0.12	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.TryAddGiventSize<Int32>.Dictionary(Count: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 11.616750866765722 > 8.436180458875302. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/16/2023 6:27:39 AM, 3/25/2023 12:18:49 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -42.48222793297871 (T) = (0 -11678.037042014726) / Math.Sqrt((57740.3836242773 / (33)) + (19994.405729138205 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.4262027100374073 = (8188.202812844485 - 11678.037042014726) / 8188.202812844485 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__baseline_a9904b6b-b51c-449e-bbf2-c5207a1a92e6.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__compare_a9904b6b-b51c-449e-bbf2-c5207a1a92e6.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__baseline_a9904b6b-b51c-449e-bbf2-c5207a1a92e6.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_TryAddGiventSize_Int32__Dictionary_Count__512__compare_a9904b6b-b51c-449e-bbf2-c5207a1a92e6.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(Int32).SerializeToWriter(Mode%3a%20Reflection).html>)	56.55 ns	62.47 ns	1.10	0.28	False	528.6872103410626	572.5012726964195	1.0828733162035298)	Trace	Trace
[SerializeToWriter - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.Json.Serialization.Tests.WriteJson(Int32).SerializeToWriter(Mode%3a%20SourceGen).html>)	57.19 ns	65.71 ns	1.15	0.28	False	524.5794428403676	572.5972029856995	1.0915357260005019)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToWriter(Mode: Reflection) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 62.465010962114754 > 59.77818230464739. IsChangePoint: Marked as a change because one of 3/20/2023 10:25:17 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -3.282792643468147 (T) = (0 -64.13785037627174) / Math.Sqrt((8.683161012843005 / (33)) + (13.211107710549202 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.1069939067540914 = (57.93875646916219 - 64.13785037627174) / 57.93875646916219 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__baseline_c4093ac7-dbad-4f8f-b32f-ea2e596b2389.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__compare_c4093ac7-dbad-4f8f-b32f-ea2e596b2389.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__baseline_c4093ac7-dbad-4f8f-b32f-ea2e596b2389.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__Reflection__compare_c4093ac7-dbad-4f8f-b32f-ea2e596b2389.log) #### System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToWriter(Mode: SourceGen) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 65.7059916223071 > 59.80905539098491. IsChangePoint: Marked as a change because one of 3/20/2023 11:25:43 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -7.055244631657767 (T) = (0 -63.546643983173944) / Math.Sqrt((4.08351217898782 / (33)) + (2.2887295178991853 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.10207305536924705 = (57.661008654170196 - 63.546643983173944) / 57.661008654170196 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__SourceGen__baseline_a97e2fc6-8855-4223-b5fb-6862fa03aa6b.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__SourceGen__compare_a97e2fc6-8855-4223-b5fb-6862fa03aa6b.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__SourceGen__baseline_a97e2fc6-8855-4223-b5fb-6862fa03aa6b.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Text_Json_Serialization_Tests_WriteJson_Int32__SerializeToWriter_Mode__SourceGen__compare_a97e2fc6-8855-4223-b5fb-6862fa03aa6b.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IntegerFormatting - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.IntegerFormatting.html>)	1.24 ms	1.43 ms	1.15	0.03	False				Trace	Trace
[InstanceDelegate - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.LowLevelPerf.InstanceDelegate.html>)	218.28 μs	249.46 μs	1.14	0.03	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.LowLevelPerf.IntegerFormatting ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.427185378787879 > 1.3073426207386363. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -178.24969619420148 (T) = (0 -1425327.749594156) / Math.Sqrt((14356712.738062494 / (33)) + (2363796.7106925794 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.14504796718820567 = (1244775.5818424 - 1425327.749594156) / 1244775.5818424 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_IntegerFormatting_baseline_ceb1a27f-7faa-4c5a-aa43-f0a550b2c6c8.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_IntegerFormatting_compare_ceb1a27f-7faa-4c5a-aa43-f0a550b2c6c8.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_IntegerFormatting_baseline_ceb1a27f-7faa-4c5a-aa43-f0a550b2c6c8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_IntegerFormatting_compare_ceb1a27f-7faa-4c5a-aa43-f0a550b2c6c8.log) #### PerfLabTests.LowLevelPerf.InstanceDelegate ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 249.4619429181929 > 229.20084411725426. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/13/2023 6:54:14 PM, 2/16/2023 9:36:08 AM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/14/2023 8:42:09 PM, 3/25/2023 12:18:49 AM, 4/10/2023 1:33:42 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -240.8829535907342 (T) = (0 -249752.98682941837) / Math.Sqrt((107234.0129021365 / (22)) + (179677.35310033747 / (15))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (15) - 2, .025) and -0.14312845215188502 = (218481.9968038327 - 249752.98682941837) / 218481.9968038327 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_InstanceDelegate_baseline_2c0f29c6-7aa8-4632-9184-360824259284.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_LowLevelPerf_InstanceDelegate_compare_2c0f29c6-7aa8-4632-9184-360824259284.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_InstanceDelegate_baseline_2c0f29c6-7aa8-4632-9184-360824259284.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_LowLevelPerf_InstanceDelegate_compare_2c0f29c6-7aa8-4632-9184-360824259284.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int32.ToString(value%3a%202147483647).html>)	10.82 ns	12.88 ns	1.19	0.05	False	137.05375571447593	149.21423140957165	1.088727781531428)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int32.ToString(value: 2147483647) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 12.8763292946219 > 11.277587711400763. IsChangePoint: Marked as a change because one of 3/2/2023 7:59:08 PM, 3/13/2023 2:14:21 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -35.080064742997436 (T) = (0 -12.951361005161385) / Math.Sqrt((0.04735868404311889 / (33)) + (0.009155552113175315 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.19802262528483472 = (10.81061470110562 - 12.951361005161385) / 10.81061470110562 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int32_ToString_value__2147483647__baseline_a2441771-f2d8-4aeb-bbc7-c6f075615d94.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int32_ToString_value__2147483647__compare_a2441771-f2d8-4aeb-bbc7-c6f075615d94.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int32_ToString_value__2147483647__baseline_a2441771-f2d8-4aeb-bbc7-c6f075615d94.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int32_ToString_value__2147483647__compare_a2441771-f2d8-4aeb-bbc7-c6f075615d94.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(Int32%2c%20Int32).Dictionary(Size%3a%20512).html>)	5.80 μs	7.37 μs	1.27	0.10	False	36111.11111111111	51786.23988226637	1.4340804890473764)	Trace	Trace
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(Int32%2c%20Int32).IDictionary(Size%3a%20512).html>)	5.24 μs	8.38 μs	1.60	0.21	True				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;Int32, Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<Int32, Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.365929456813517 > 6.1044136654565815. IsChangePoint: Marked as a change because one of 2/24/2023 12:59:32 PM, 3/15/2023 12:03:45 AM, 3/31/2023 8:05:26 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -5.440972389280832 (T) = (0 -6710.4888085648345) / Math.Sqrt((61018.19894133913 / (33)) + (197598.7929439055 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.22482080182751102 = (5478.751502711544 - 6710.4888085648345) / 5478.751502711544 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__baseline_ceb10e9f-4134-4d4f-8262-8bbff9c1cd0d.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__compare_ceb10e9f-4134-4d4f-8262-8bbff9c1cd0d.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__baseline_ceb10e9f-4134-4d4f-8262-8bbff9c1cd0d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__Dictionary_Size__512__compare_ceb10e9f-4134-4d4f-8262-8bbff9c1cd0d.log) #### System.Collections.ContainsKeyTrue<Int32, Int32>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 8.378121427295461 > 5.665469019874936. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -27.602406693626932 (T) = (0 -8466.204783548461) / Math.Sqrt((243794.75509505652 / (33)) + (23779.06782196536 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.6037350363791183 = (5279.054576660801 - 8466.204783548461) / 5279.054576660801 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__baseline_11819eb4-1ca4-4b42-9f5d-8278ec22f0bc.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__compare_11819eb4-1ca4-4b42-9f5d-8278ec22f0bc.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__baseline_11819eb4-1ca4-4b42-9f5d-8278ec22f0bc.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_Int32__Int32__IDictionary_Size__512__compare_11819eb4-1ca4-4b42-9f5d-8278ec22f0bc.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern%3a%20%22(%3f%3a(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%5c%5c.)%7b3%7d(%3f%3a25%5b0-5%5d%7c2%5b0-4%5d%5b0-9%5d%7c%5b01%5d%3f%5b0-9%5d%5b0-9%5d)%22%2c%20Options%3a%20NonBacktracking).html>)	343.01 μs	367.93 μs	1.07	0.00	False

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Ctor(Pattern: "(?:(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])\\.){3}(?:25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9])", Options: NonBacktracking) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 367.9321114369501 > 362.32432013716897. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.41398540515947 (T) = (0 -367556.98112636805) / Math.Sqrt((6707592.395633373 / (33)) + (118076.08104292373 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.0663683956609358 = (344681.0526474352 - 367556.98112636805) / 344681.0526474352 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).Dictionary(Size%3a%20512).html>)	2.93 μs	4.53 μs	1.55	0.01	True				Trace	Trace
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(Int32).FrozenDictionary(Size%3a%20512).html>)	2.99 μs	4.54 μs	1.52	0.01	True	23666.246586851503	40235.149806869194	1.700106929048185)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.53007818936398 > 3.085368876493969. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -113.74975162738032 (T) = (0 -4521.674708885474) / Math.Sqrt((157.24064275449737 / (33)) + (760.760397910562 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.5414295873840802 = (2933.4292956962695 - 4521.674708885474) / 2933.4292956962695 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__Dictionary_Size__512__baseline_58f715c8-47e0-4749-9db1-62585b0f8ec7.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__Dictionary_Size__512__compare_58f715c8-47e0-4749-9db1-62585b0f8ec7.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__Dictionary_Size__512__baseline_58f715c8-47e0-4749-9db1-62585b0f8ec7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__Dictionary_Size__512__compare_58f715c8-47e0-4749-9db1-62585b0f8ec7.log) #### System.Collections.CtorFromCollection<Int32>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 4.541473603047895 > 3.11886766243859. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -115.25185870322188 (T) = (0 -4559.897696469172) / Math.Sqrt((126.87341335158244 / (33)) + (747.9022715156829 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.5364390182720897 = (2967.835131912573 - 4559.897696469172) / 2967.835131912573 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__baseline_e356baf0-ac3e-4aaa-bc53-e37cb27b2265.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__compare_e356baf0-ac3e-4aaa-bc53-e37cb27b2265.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__baseline_e356baf0-ac3e-4aaa-bc53-e37cb27b2265.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_Int32__FrozenDictionary_Size__512__compare_e356baf0-ac3e-4aaa-bc53-e37cb27b2265.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

performanceautofiler[bot] commented 1 year ago

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in PerfLabTests.CastingPerf2.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FooObjIsDescendant - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant.html>)	405.41 μs	516.94 μs	1.28	0.06	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

### Payloads [Baseline]() [Compare]() ### Histogram #### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 516.9351075268817 > 425.6900190304487. IsChangePoint: Marked as a change because one of 2/9/2023 4:27:10 AM, 2/24/2023 9:01:57 AM, 3/17/2023 10:06:19 AM, 3/27/2023 8:33:24 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -24.718710075879162 (T) = (0 -521557.0079525089) / Math.Sqrt((427584740.0285614 / (33)) + (29368450.71952191 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.2715081783920005 = (410187.6942797887 - 521557.0079525089) / 410187.6942797887 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_CastingPerf2_CastingPerf_FooObjIsDescendant_baseline_7399d155-b770-4f16-92cd-b286be72ba28.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/PerfLabTests_CastingPerf2_CastingPerf_FooObjIsDescendant_compare_7399d155-b770-4f16-92cd-b286be72ba28.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_CastingPerf2_CastingPerf_FooObjIsDescendant_baseline_7399d155-b770-4f16-92cd-b286be72ba28.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FPerfLabTests_CastingPerf2_CastingPerf_FooObjIsDescendant_compare_7399d155-b770-4f16-92cd-b286be72ba28.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Decimal

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Decimal.ToString(value%3a%20123456.789).html>)	75.77 ns	84.57 ns	1.12	0.02	False	761.8204195956279	816.9143843404335	1.072318834370506)	Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Decimal*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Decimal.ToString(value: 123456.789) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 84.56867788127347 > 79.89214600944706. IsChangePoint: Marked as a change because one of 2/17/2023 5:12:50 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -10.485235887198638 (T) = (0 -83.07084242169189) / Math.Sqrt((1.352752767421935 / (33)) + (1.1204494395836162 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.07703399991440565 = (77.12926651182202 - 83.07084242169189) / 77.12926651182202 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Decimal_ToString_value__123456_789__baseline_06f63d23-9fcc-4cb1-8ca2-cef8a11ca6a7.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Decimal_ToString_value__123456_789__compare_06f63d23-9fcc-4cb1-8ca2-cef8a11ca6a7.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Decimal_ToString_value__123456_789__baseline_06f63d23-9fcc-4cb1-8ca2-cef8a11ca6a7.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Decimal_ToString_value__123456_789__compare_06f63d23-9fcc-4cb1-8ca2-cef8a11ca6a7.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndRemove(Int32).HashSet(Size%3a%20512).html>)	16.86 μs	18.88 μs	1.12	0.01	False				Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CreateAddAndRemove(Int32).Dictionary(Size%3a%20512).html>)	21.06 μs	28.21 μs	1.34	0.08	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;Int32&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CreateAddAndRemove<Int32>.HashSet(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 18.882741626311542 > 17.818510539362897. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -16.441102037640015 (T) = (0 -18771.982519328) / Math.Sqrt((58794.226459676014 / (33)) + (31396.80935263934 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.09403373980369041 = (17158.50419996771 - 18771.982519328) / 17158.50419996771 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__baseline_518d9296-6aab-4f66-b5fe-a76ebb031730.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__compare_518d9296-6aab-4f66-b5fe-a76ebb031730.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__baseline_518d9296-6aab-4f66-b5fe-a76ebb031730.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__HashSet_Size__512__compare_518d9296-6aab-4f66-b5fe-a76ebb031730.log) #### System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 28.205651323706377 > 22.037005043000043. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -43.511910575085786 (T) = (0 -28527.632426107248) / Math.Sqrt((232627.2059490273 / (33)) + (80445.02109783802 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.3357716671707829 = (21356.668304344184 - 28527.632426107248) / 21356.668304344184 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__baseline_360c4460-9dd3-49e7-862b-6d6339115fe8.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__compare_360c4460-9dd3-49e7-862b-6d6339115fe8.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__baseline_360c4460-9dd3-49e7-862b-6d6339115fe8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CreateAddAndRemove_Int32__Dictionary_Size__512__compare_360c4460-9dd3-49e7-862b-6d6339115fe8.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[FrozenDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).FrozenDictionary(Size%3a%20512).html>)	6.17 μs	7.96 μs	1.29	0.01	True	38580.44054091733	54294.21768707484	1.407299059467502)	Trace	Trace
[Dictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.CtorFromCollection(String).Dictionary(Size%3a%20512).html>)	6.09 μs	7.79 μs	1.28	0.00	True				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.CtorFromCollection<String>.FrozenDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.963619181107713 > 6.483098809190382. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -47.231682502388196 (T) = (0 -7951.553965511117) / Math.Sqrt((6434.345329218786 / (33)) + (4624.20653869555 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.279312880195102 = (6215.488086306505 - 7951.553965511117) / 6215.488086306505 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__baseline_c1d938b4-b6e3-4fe4-940a-603a777b6d4f.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__compare_c1d938b4-b6e3-4fe4-940a-603a777b6d4f.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__baseline_c1d938b4-b6e3-4fe4-940a-603a777b6d4f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__FrozenDictionary_Size__512__compare_c1d938b4-b6e3-4fe4-940a-603a777b6d4f.log) #### System.Collections.CtorFromCollection<String>.Dictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 7.789860141313384 > 6.417017727795876. IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -76.76870890865206 (T) = (0 -7777.874621621269) / Math.Sqrt((12112.76403105744 / (33)) + (265.2688802682051 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.25860919273421673 = (6179.737655280053 - 7777.874621621269) / 6179.737655280053 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked as regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__Dictionary_Size__512__baseline_632afeaa-27c5-4581-ab58-fec01e249765.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_CtorFromCollection_String__Dictionary_Size__512__compare_632afeaa-27c5-4581-ab58-fec01e249765.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__Dictionary_Size__512__baseline_632afeaa-27c5-4581-ab58-fec01e249765.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_CtorFromCollection_String__Dictionary_Size__512__compare_632afeaa-27c5-4581-ab58-fec01e249765.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Collections.ContainsKeyTrue(String%2c%20String).IDictionary(Size%3a%20512).html>)	15.67 μs	20.10 μs	1.28	0.01	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Collections.ContainsKeyTrue<String, String>.IDictionary(Size: 512) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 20.098194649901384 > 16.361658944526212. IsChangePoint: Marked as a change because one of 1/30/2023 9:42:46 PM, 3/14/2023 8:42:09 PM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -69.79343684026433 (T) = (0 -20274.786431016768) / Math.Sqrt((14510.522314418367 / (33)) + (15900.80396596973 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.29655951877136555 = (15637.374248911754 - 20274.786431016768) / 15637.374248911754 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__baseline_bf977bb1-0450-4640-94c6-a32b3147c25a.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__compare_bf977bb1-0450-4640-94c6-a32b3147c25a.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__baseline_bf977bb1-0450-4640-94c6-a32b3147c25a.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Collections_ContainsKeyTrue_String__String__IDictionary_Size__512__compare_bf977bb1-0450-4640-94c6-a32b3147c25a.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[TryFormat - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Int64.TryFormat(value%3a%20-9223372036854775808).html>)	58.81 ns	64.49 ns	1.10	0.00	False	454.83568930725914	495.8600978045694	1.0901961069936987)	Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808) ```log ``` ### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 64.48695577650678 > 61.19462405090689. IsChangePoint: Marked as a change because one of 2/19/2023 8:14:07 AM, 4/12/2023 8:39:35 PM, 4/18/2023 3:11:52 AM falls between 4/9/2023 1:58:52 PM and 4/18/2023 3:11:52 AM. IsRegressionStdDev: Marked as regression because -14.224485843016705 (T) = (0 -63.518382108843426) / Math.Sqrt((0.11494546914952194 / (33)) + (0.4864058087239351 / (4))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (4) - 2, .025) and -0.08601516899039703 = (58.48756437526802 - 63.518382108843426) / 58.48756437526802 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` ### Baseline JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__baseline_97ff90f0-ef19-44a2-ad2b-11dabf3629cd.log) ### Compare JIT Disasm [Complete output](https://pvscmdupload.z22.web.core.windows.net/autofilereport/04_18_2023/System_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__compare_97ff90f0-ef19-44a2-ad2b-11dabf3629cd.log) ### JIT Disasm Diff [Link](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__baseline_97ff90f0-ef19-44a2-ad2b-11dabf3629cd.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2F04_18_2023%2FSystem_Tests_Perf_Int64_TryFormat_value__-9223372036854775808__compare_97ff90f0-ef19-44a2-ad2b-11dabf3629cd.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name	Value
Architecture	x86
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Reflection.Attributes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
[IsDefinedClassMissInherit - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Reflection.Attributes.IsDefinedClassMissInherit.html>)	794.51 ns	845.89 ns	1.06	0.02	False				Trace	Trace

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads