search

DrewScoggins / performance-2

This repo contains benchmarks used for testing the performance of all .NET Runtimes
MIT License
0 stars 0 forks source link

[Perf] Windows/x86: 15 Regressions on 7/12/2023 7:15:00 AM #8860

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Double.TryParse(value%3a%20%221.7976931348623157e%2b308%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 154.71 ns 206.16 ns 1.33 0.05 False 1837.192175069914 2019.7486407343094 1.0993671038564317)
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Double.Parse(value%3a%20%22-1.7976931348623157e%2b308%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 167.87 ns 226.36 ns 1.35 0.07 False 1869.8217328763744 2087.413900604498 1.1163705415881535)
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Double.TryParse(value%3a%20%2212345%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 76.14 ns 101.77 ns 1.34 0.04 False 882.7424666240627 1041.5834199099602 1.179940310216823)
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Double.Parse(value%3a%20%221.7976931348623157e%2b308%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 159.35 ns 222.41 ns 1.40 0.06 False 1842.8593948811495 2064.9007990363675 1.1204874364110335)
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Double.TryParse(value%3a%20%22-1.7976931348623157e%2b308%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 158.05 ns 209.95 ns 1.33 0.06 False 1876.0182980323348 2039.5116196194772 1.0871491081716116)

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'
### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_Double.TryParse(value: "1.7976931348623157e+308") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-f81b5624e7f544ceb8/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20_1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_1.7976931348623157e%2B308_%29-20230720-125623.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A02Z&sr=c&sp=rl&sig=naqHIy4BEmkAyHpb9D3CY72isg%2FqwTflmkJmuuWwSrk%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-53dc2139d79845af88/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20_1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_1.7976931348623157e%2B308_%29-20230720-125627.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A01Z&sr=c&sp=rl&sig=OYCC7pegnomoy5WWwocA%2FKKHY6Fmxo81NQWdjlGE3js%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 206.1616740372033 > 163.91885602692105. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -24.268687594695272 (T) = (0 -203.10526611274696) / Math.Sqrt((5.03791256844267 / (20)) + (33.65310713006253 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.29408647096847684 = (156.94875935202825 - 203.10526611274696) / 156.94875935202825 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___1_7976931348623157e_308___baseline_5af77899-9d00-410a-8998-1f390a8cf9dc.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___1_7976931348623157e_308___compare_5af77899-9d00-410a-8998-1f390a8cf9dc.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___1_7976931348623157e_308___baseline_5af77899-9d00-410a-8998-1f390a8cf9dc.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___1_7976931348623157e_308___compare_5af77899-9d00-410a-8998-1f390a8cf9dc.log) ### System.Tests.Perf_Double.Parse(value: "-1.7976931348623157e+308") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-69a688a0098943848e/Collect%20System.Tests.Perf_Double.Parse_value%3A%20__1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.Parse%28value_%20_-1.7976931348623157e%2B308_%29-20230720-125706.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A06Z&sr=c&sp=rl&sig=aEov7Uqn5OipDt3jCfd%2FHjjXnoZGtoAM40%2B92SS53S4%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-16f960b37e314acca0/Collect%20System.Tests.Perf_Double.Parse_value%3A%20__1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.Parse%28value_%20_-1.7976931348623157e%2B308_%29-20230720-125704.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A06Z&sr=c&sp=rl&sig=MeVxCbgdoTy0sMxFVcJh8XWHc0Fl0h8hfQ%2BdY1NbXGY%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 226.3639746861434 > 172.40457462658503. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -31.703808328243404 (T) = (0 -222.5533590995141) / Math.Sqrt((6.348274154294897 / (20)) + (29.694082570350492 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.34819019216278063 = (165.07564021252202 - 222.5533590995141) / 165.07564021252202 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_Parse_value___-1_7976931348623157e_308___baseline_f53ee5f3-3de3-4ccc-8cde-b0ee1eab28b8.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_Parse_value___-1_7976931348623157e_308___compare_f53ee5f3-3de3-4ccc-8cde-b0ee1eab28b8.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_Parse_value___-1_7976931348623157e_308___baseline_f53ee5f3-3de3-4ccc-8cde-b0ee1eab28b8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_Parse_value___-1_7976931348623157e_308___compare_f53ee5f3-3de3-4ccc-8cde-b0ee1eab28b8.log) ### System.Tests.Perf_Double.TryParse(value: "12345") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-5b6ab7410b004a7a8e/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_12345_%29-20230720-125953.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A09Z&sr=c&sp=rl&sig=jNA01%2F%2FStYgfvO2xMq4Woc8cRyNo0sdmWdZiBfR%2B9%2BU%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-9c1fac2ecbb74bc5a5/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_12345_%29-20230720-125944.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A09Z&sr=c&sp=rl&sig=Li7HXyQzBigk6fO%2FCdhiD01vVZC0n99CB4P%2B4ssGg2U%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 101.76831718639846 > 80.2320554781639. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -56.30187920576447 (T) = (0 -100.37874876140565) / Math.Sqrt((1.5106963370343105 / (20)) + (0.9591841792076848 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.3025057224149086 = (77.06587927713561 - 100.37874876140565) / 77.06587927713561 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___12345___baseline_8a64db3b-d938-4037-b7a3-305a8531bb17.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___12345___compare_8a64db3b-d938-4037-b7a3-305a8531bb17.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___12345___baseline_8a64db3b-d938-4037-b7a3-305a8531bb17.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___12345___compare_8a64db3b-d938-4037-b7a3-305a8531bb17.log) ### System.Tests.Perf_Double.Parse(value: "1.7976931348623157e+308") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-181ec6f0a84944eb85/Collect%20System.Tests.Perf_Double.Parse_value%3A%20_1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.Parse%28value_%20_1.7976931348623157e%2B308_%29-20230720-130004.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A10Z&sr=c&sp=rl&sig=wCYXB6XBXMi98hBCcIeV0S3Xuv1RBxTpgiU5%2BFjkIuc%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-4afd2cdf314344eea5/Collect%20System.Tests.Perf_Double.Parse_value%3A%20_1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.Parse%28value_%20_1.7976931348623157e%2B308_%29-20230720-130006.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A10Z&sr=c&sp=rl&sig=YIcwIALVTXEJUc0CO%2B11yXZqEJHV3Z7tYIPNp7ofBIw%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 222.40844357986242 > 167.62925015934067. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -34.67764083561169 (T) = (0 -217.9936095802268) / Math.Sqrt((7.104861764906695 / (20)) + (24.357710840089144 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.36194930256634056 = (160.0600030922284 - 217.9936095802268) / 160.0600030922284 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_Parse_value___1_7976931348623157e_308___baseline_b6d8dbe6-1962-429f-b8af-9ff9b1ff327f.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_Parse_value___1_7976931348623157e_308___compare_b6d8dbe6-1962-429f-b8af-9ff9b1ff327f.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_Parse_value___1_7976931348623157e_308___baseline_b6d8dbe6-1962-429f-b8af-9ff9b1ff327f.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_Parse_value___1_7976931348623157e_308___compare_b6d8dbe6-1962-429f-b8af-9ff9b1ff327f.log) ### System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-19ee066e513b492199/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20__1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_-1.7976931348623157e%2B308_%29-20230720-130320.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A20Z&sr=c&sp=rl&sig=S6zMhf7uCNpAQ1jB%2FPA08y1ufhA%2BbqedAepoFCHBd0Y%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-efb066e3200e443a87/Collect%20System.Tests.Perf_Double.TryParse_value%3A%20__1.7976931348623157e_308__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Double.TryParse%28value_%20_-1.7976931348623157e%2B308_%29-20230720-130315.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A20Z&sr=c&sp=rl&sig=yMwJA2TGaVW3qyRWOw8Kxeff%2F54yvTUJn9B9HQLF%2F4s%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 209.94939302539785 > 165.5101036119369. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -27.17299397734961 (T) = (0 -205.9778501150265) / Math.Sqrt((6.726053185837706 / (20)) + (26.06575153357045 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.2925067624760943 = (159.363073443754 - 205.9778501150265) / 159.363073443754 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___-1_7976931348623157e_308___baseline_c7528648-cf7a-40d5-b35e-46127e8adc97.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Double_TryParse_value___-1_7976931348623157e_308___compare_c7528648-cf7a-40d5-b35e-46127e8adc97.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___-1_7976931348623157e_308___baseline_c7528648-cf7a-40d5-b35e-46127e8adc97.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Double_TryParse_value___-1_7976931348623157e_308___compare_c7528648-cf7a-40d5-b35e-46127e8adc97.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.TryParse(value%3a%20%2212345%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 73.03 ns 97.90 ns 1.34 0.09 False
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.Parse(value%3a%20%22-3.4028235E%2b38%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 121.58 ns 142.62 ns 1.17 0.10 False 1348.0769958841058 1459.2841903592166 1.0824932068529054)
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.Parse(value%3a%20%2212345%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 77.15 ns 103.72 ns 1.34 0.04 False 884.7697143792362 1048.7082806303424 1.1852895319389716)
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.TryParse(value%3a%20%223.4028235E%2b38%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 114.50 ns 145.00 ns 1.27 0.08 False
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.TryParse(value%3a%20%22-3.4028235E%2b38%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 118.19 ns 141.61 ns 1.20 0.11 False
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Single.Parse(value%3a%20%223.4028235E%2b38%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 118.64 ns 140.41 ns 1.18 0.10 False 1295.2117979455193 1435.6362946800748 1.108418172963911)

graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'
### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_Single.TryParse(value: "12345") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-db029f9cd47d4484a8/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_12345_%29-20230720-125633.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A03Z&sr=c&sp=rl&sig=bYr7bR%2B0FGJxR4PcW650cR3G%2F0iVh%2FIHAJrEpqLLra4%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-68e84af481894176a0/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_12345_%29-20230720-125541.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A03Z&sr=c&sp=rl&sig=js2g6hjxK6dKvXAo1K89QylpCUfKDzAJMVBtqL0knfc%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 97.90280989331103 > 77.67920814482028. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -46.32724842263667 (T) = (0 -97.87578565929309) / Math.Sqrt((2.049064597138123 / (20)) + (1.6559177621741343 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.32460132714373113 = (73.89075010995568 - 97.87578565929309) / 73.89075010995568 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___12345___baseline_38dc961c-b299-4928-9968-00b8d8694c6d.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___12345___compare_38dc961c-b299-4928-9968-00b8d8694c6d.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___12345___baseline_38dc961c-b299-4928-9968-00b8d8694c6d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___12345___compare_38dc961c-b299-4928-9968-00b8d8694c6d.log) ### System.Tests.Perf_Single.Parse(value: "-3.4028235E+38") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-f1cd75a65fc84d21aa/Collect%20System.Tests.Perf_Single.Parse_value%3A%20__3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_-3.4028235E%2B38_%29-20230720-125645.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A04Z&sr=c&sp=rl&sig=J6xDLTjw1wH8Vh%2F9fDABgm74lGjh2QFyJcnbTLFidvc%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-02f707e24c0a4ec2af/Collect%20System.Tests.Perf_Single.Parse_value%3A%20__3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_-3.4028235E%2B38_%29-20230720-125641.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A03Z&sr=c&sp=rl&sig=3%2BT2tsgrDEI1wDrkPeVqgjg7TXsfbzDuDZrSGcGTIf8%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 142.62492185074854 > 125.45647660183448. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -18.240965609515577 (T) = (0 -141.29143339682435) / Math.Sqrt((1.7938481670549375 / (20)) + (12.11015838194278 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.1726610793592374 = (120.48786804967422 - 141.29143339682435) / 120.48786804967422 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___-3_4028235E_38___baseline_6dc49121-8d85-4b63-8768-26ff261a2afc.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___-3_4028235E_38___compare_6dc49121-8d85-4b63-8768-26ff261a2afc.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___-3_4028235E_38___baseline_6dc49121-8d85-4b63-8768-26ff261a2afc.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___-3_4028235E_38___compare_6dc49121-8d85-4b63-8768-26ff261a2afc.log) ### System.Tests.Perf_Single.Parse(value: "12345") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-de5923e0a5cb46b2af/Collect%20System.Tests.Perf_Single.Parse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_12345_%29-20230720-125606.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A05Z&sr=c&sp=rl&sig=iMtZesqDSnCIckQNfLX99BSLii8ZL8s0YuPsaQyOj0w%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-d69a1eb7cab449b483/Collect%20System.Tests.Perf_Single.Parse_value%3A%20_12345__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_12345_%29-20230720-125658.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A05Z&sr=c&sp=rl&sig=3srTYqz%2BBTdJb4nSC5M6An9XmGqHTpKSGlsZxyfhu48%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 103.71752324004801 > 80.68242203174006. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -42.98608244365839 (T) = (0 -102.5537376145825) / Math.Sqrt((1.9499363550511275 / (20)) + (2.6207901244937237 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.33573015477351414 = (76.77728712501177 - 102.5537376145825) / 76.77728712501177 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___12345___baseline_3863008e-2fd4-497e-b2db-1c83d4c74485.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___12345___compare_3863008e-2fd4-497e-b2db-1c83d4c74485.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___12345___baseline_3863008e-2fd4-497e-b2db-1c83d4c74485.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___12345___compare_3863008e-2fd4-497e-b2db-1c83d4c74485.log) ### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-8f52ae4ef0434089b8/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20_3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_3.4028235E%2B38_%29-20230720-125825.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A07Z&sr=c&sp=rl&sig=JANPDArfzc999sYH0JX5YAz0abkngXf30%2BQG4XabDK8%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-f40bdc9c8f8f409185/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20_3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_3.4028235E%2B38_%29-20230720-125803.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A07Z&sr=c&sp=rl&sig=YR3W69KtQkFwZxTFqNlXcEhYf657QIA5FBv%2FN5PSmB0%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 144.99679636385898 > 120.3989877610473. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -13.60601936814509 (T) = (0 -137.4133876348615) / Math.Sqrt((3.1832726560550455 / (20)) + (22.424970795483812 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.18126068419022165 = (116.32774160181347 - 137.4133876348615) / 116.32774160181347 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___3_4028235E_38___baseline_b8c6a2e3-b10d-429c-b384-5b75300de0a8.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___3_4028235E_38___compare_b8c6a2e3-b10d-429c-b384-5b75300de0a8.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___3_4028235E_38___baseline_b8c6a2e3-b10d-429c-b384-5b75300de0a8.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___3_4028235E_38___compare_b8c6a2e3-b10d-429c-b384-5b75300de0a8.log) ### System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-e7970f10f9f14795b3/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20__3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_-3.4028235E%2B38_%29-20230720-130026.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A11Z&sr=c&sp=rl&sig=wMnu93LgxEAkyYhNcMj4QZcuFZrY%2Fytub2MRfTQF6ds%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-10974c4695624eb781/Collect%20System.Tests.Perf_Single.TryParse_value%3A%20__3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.TryParse%28value_%20_-3.4028235E%2B38_%29-20230720-130056.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A11Z&sr=c&sp=rl&sig=MHrNlh%2BwF%2B4GKMjPWInTPRioWvsIInoRkeST8Aupo0Q%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 141.61230685681303 > 125.10596283323966. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -28.810338758859604 (T) = (0 -138.39651304304132) / Math.Sqrt((2.0910859856103734 / (20)) + (3.0640871315649907 / (9))) is less than -2.051830516474954 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (9) - 2, .025) and -0.16126437445399458 = (119.17743804731188 - 138.39651304304132) / 119.17743804731188 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___-3_4028235E_38___baseline_0081a3bd-64ce-40bd-b9d6-a3dc163f5de0.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_TryParse_value___-3_4028235E_38___compare_0081a3bd-64ce-40bd-b9d6-a3dc163f5de0.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___-3_4028235E_38___baseline_0081a3bd-64ce-40bd-b9d6-a3dc163f5de0.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_TryParse_value___-3_4028235E_38___compare_0081a3bd-64ce-40bd-b9d6-a3dc163f5de0.log) ### System.Tests.Perf_Single.Parse(value: "3.4028235E+38") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-c213ace308094fae83/Collect%20System.Tests.Perf_Single.Parse_value%3A%20_3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_3.4028235E%2B38_%29-20230720-130339.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A18Z&sr=c&sp=rl&sig=8Up%2Fn13hzfg9HAPNOWkUNsbVD%2BD8%2BDMP0Dapt5FPDZI%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-a3588e233d454975b2/Collect%20System.Tests.Perf_Single.Parse_value%3A%20_3.4028235E_38__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Single.Parse%28value_%20_3.4028235E%2B38_%29-20230720-130343.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A18Z&sr=c&sp=rl&sig=IZoAtdJghH2fYTn0IleItRZMvRxdsgM1Oos%2F4Fx%2BG6U%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 140.40686575668846 > 124.65590810378336. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -19.095373875998074 (T) = (0 -137.91038693032135) / Math.Sqrt((1.87711889791486 / (20)) + (10.107863702197736 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.1703112822314758 = (117.84077366780787 - 137.91038693032135) / 117.84077366780787 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___3_4028235E_38___baseline_d680c1f1-0a48-4071-8744-4af22ea0df8d.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Single_Parse_value___3_4028235E_38___compare_d680c1f1-0a48-4071-8744-4af22ea0df8d.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___3_4028235E_38___baseline_d680c1f1-0a48-4071-8744-4af22ea0df8d.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Single_Parse_value___3_4028235E_38___compare_d680c1f1-0a48-4071-8744-4af22ea0df8d.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Decimal

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
[TryParse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Decimal.TryParse(value%3a%20%22123456.789%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 98.41 ns 130.96 ns 1.33 0.13 False 1177.9179602351542 1398.254206259778 1.1870556808392978)
[Parse - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Decimal.Parse(value%3a%20%22123456.789%22).html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 101.08 ns 135.77 ns 1.34 0.11 False 1189.764046701523 1399.3380251426822 1.1761475134688912)

graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Decimal*'
### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_Decimal.TryParse(value: "123456.789") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-fdb4e31841a248cd91/Collect%20System.Tests.Perf_Decimal.TryParse_value%3A%20_123456.789__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Decimal.TryParse%28value_%20_123456.789_%29-20230720-130058.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A12Z&sr=c&sp=rl&sig=ubqqK965dqGCvbGqvzEpGu854P5ld3GAofAVk3toIIA%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-10795a9877734df6ba/Collect%20System.Tests.Perf_Decimal.TryParse_value%3A%20_123456.789__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Decimal.TryParse%28value_%20_123456.789_%29-20230720-130057.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A12Z&sr=c&sp=rl&sig=xN4b3DDR%2B%2BcJoYT1pfycIh0GhwpVJt8AnGV%2F%2Fm5%2BrAE%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 130.95809351954003 > 103.23493123517041. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -25.85659254910573 (T) = (0 -127.64073003264106) / Math.Sqrt((3.012071780175555 / (20)) + (9.234097019803162 / (9))) is less than -2.051830516474954 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (9) - 2, .025) and -0.2816157351207657 = (99.59360402251426 - 127.64073003264106) / 99.59360402251426 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Decimal_TryParse_value___123456_789___baseline_5e81f1ad-2a3b-42b2-a30b-de9fdcbda3df.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Decimal_TryParse_value___123456_789___compare_5e81f1ad-2a3b-42b2-a30b-de9fdcbda3df.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Decimal_TryParse_value___123456_789___baseline_5e81f1ad-2a3b-42b2-a30b-de9fdcbda3df.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Decimal_TryParse_value___123456_789___compare_5e81f1ad-2a3b-42b2-a30b-de9fdcbda3df.log) ### System.Tests.Perf_Decimal.Parse(value: "123456.789") #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-82ab894cab8f4a7da0/Collect%20System.Tests.Perf_Decimal.Parse_value%3A%20_123456.789__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Decimal.Parse%28value_%20_123456.789_%29-20230720-130324.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A21Z&sr=c&sp=rl&sig=ErXgRw7EIQxl%2BtubG4Apj7%2FrpgYoigb8yfAfCEFbRrA%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-f31be50c32a04a2c8a/Collect%20System.Tests.Perf_Decimal.Parse_value%3A%20_123456.789__/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Decimal.Parse%28value_%20_123456.789_%29-20230720-130417.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A21Z&sr=c&sp=rl&sig=c7Teb3Z9hpbo1le1dJjPIWkrtLKrjeLYAtca48rjF1w%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 135.77264957210906 > 106.39064392451844. IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -23.15926392813045 (T) = (0 -129.34057318075753) / Math.Sqrt((7.188703566722158 / (19)) + (10.696337086591829 / (10))) is less than -2.051830516474954 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (10) - 2, .025) and -0.27463676303041273 = (101.47249548432448 - 129.34057318075753) / 101.47249548432448 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Decimal_Parse_value___123456_789___baseline_c7594915-463e-440f-bcf0-51f67624380b.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Decimal_Parse_value___123456_789___compare_c7594915-463e-440f-bcf0-51f67624380b.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Decimal_Parse_value___123456_789___baseline_c7594915-463e-440f-bcf0-51f67624380b.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Decimal_Parse_value___123456_789___compare_c7594915-463e-440f-bcf0-51f67624380b.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in LinqBenchmarks

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
[Count00LinqMethodX - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/LinqBenchmarks.Count00LinqMethodX.html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 941.81 ms 1.04 secs 1.10 0.05 False

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'
### Payloads [Baseline]() [Compare]() ### LinqBenchmarks.Count00LinqMethodX #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-520526201092499b98/Collect%20LinqBenchmarks.Count00LinqMethodX/1/artifacts/BenchmarkDotNet.Artifacts/LinqBenchmarks.Count00LinqMethodX-20230720-130321.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A20Z&sr=c&sp=rl&sig=FVGTIKZ8XF0Oh2NEEwugF9CbufVrDUW%2BNZHZKcVf6P8%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-4559b5d74c50443597/Collect%20LinqBenchmarks.Count00LinqMethodX/1/artifacts/BenchmarkDotNet.Artifacts/LinqBenchmarks.Count00LinqMethodX-20230720-130406.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A19Z&sr=c&sp=rl&sig=JBIXvuk0aZBFmgptJXUmKomkIutvzWFsnurCmcNv7WM%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 1.0362634533333335 > 995.9789560000002. IsChangePoint: Marked as a change because one of 5/3/2023 11:54:24 PM, 5/8/2023 6:34:59 AM, 7/5/2023 7:07:19 PM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -5.211640677500419 (T) = (0 -997842115.3809525) / Math.Sqrt((26570383360015.574 / (20)) + (867971451123301.4 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.05155812565183239 = (948917697.5 - 997842115.3809525) / 948917697.5 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/LinqBenchmarks_Count00LinqMethodX_baseline_07a1165e-0486-4888-acff-79de22fee750.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/LinqBenchmarks_Count00LinqMethodX_compare_07a1165e-0486-4888-acff-79de22fee750.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FLinqBenchmarks_Count00LinqMethodX_baseline_07a1165e-0486-4888-acff-79de22fee750.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FLinqBenchmarks_Count00LinqMethodX_compare_07a1165e-0486-4888-acff-79de22fee750.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x86
OS Windows 10.0.18362
Queue TigerWindows
Baseline 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Version

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
[TryParse4 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x86_Windows 10.0.18362/System.Tests.Perf_Version.TryParse4.html>)
📝 - Benchmark Source
ADX - Test Multi COnfig Graph		 55.09 ns 89.17 ns 1.62 0.03 False 682.3421627553433 699.9386215362548 1.0257883210819858)

graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'
### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_Version.TryParse4 #### ETL Files [Baseline](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-44fae5502128417bb3/Collect%20System.Tests.Perf_Version.TryParse4/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Version.TryParse4-20230720-130336.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A22Z&sr=c&sp=rl&sig=LrDg6vxY5treqMTguwq1cxG%2Ff%2B6O24%2BlV7%2BFVRk16UI%3D) [Compare](https://helixri107v0xdeko0k025g8.blob.core.windows.net/results-d84f4b0d59d14f7a97/Collect%20System.Tests.Perf_Version.TryParse4/1/artifacts/BenchmarkDotNet.Artifacts/System.Tests.Perf_Version.TryParse4-20230720-130335.etl?sv=2021-08-06&se=2023-10-18T19%3A54%3A22Z&sr=c&sp=rl&sig=TYSPyLOKwuOm0RsNiGU0D5%2FmypMxm0x9G1bWBYIo5WE%3D) #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline. IsRegressionWindowed: Marked as regression because 89.17424976746462 > 57.80110316564057. IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 6/5/2023 10:43:22 AM, 6/9/2023 2:21:24 AM, 6/22/2023 7:55:14 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM. IsRegressionStdDev: Marked as regression because -3.2764715072777686 (T) = (0 -64.16702774431104) / Math.Sqrt((0.015363355572409762 / (20)) + (77.97762676382254 / (10))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (10) - 2, .025) and -0.16630843925011748 = (55.01720264115338 - 64.16702774431104) / 55.01720264115338 is less than -0.05. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so. ``` #### JIT Disasms [Baseline](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Version_TryParse4_baseline_4b22d1fb-ea60-47a8-b59d-7371f38213af.log) [Compare](https://pvscmdupload.blob.core.windows.net/autofilereport/jitdasms/07_18_2023/System_Tests_Perf_Version_TryParse4_compare_4b22d1fb-ea60-47a8-b59d-7371f38213af.log) [Diff](https://perfsupport.azurewebsites.net/diff?old=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Version_TryParse4_baseline_4b22d1fb-ea60-47a8-b59d-7371f38213af.log&new=https%3A%2F%2Fpvscmdupload.blob.core.windows.net%2Fautofilereport%2Fjitdasms%2F07_18_2023%2FSystem_Tests_Perf_Version_TryParse4_compare_4b22d1fb-ea60-47a8-b59d-7371f38213af.log) ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)