performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Collections.Concurrent.IsEmpty<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Concurrent.IsEmpty(Int32).Bag(Size%3a%200).html>) | 40.65 ns | 54.50 ns | 1.34 | 0.25 | False | |||||
| [Bag - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Concurrent.IsEmpty(Int32).Bag(Size%3a%20512).html>) | 36.41 ns | 43.16 ns | 1.19 | 0.12 | False | |||||
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Concurrent.IsEmpty(Int32).Queue(Size%3a%200).html>) | 17.95 ns | 20.09 ns | 1.12 | 0.01 | False | |||||
| [Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.Concurrent.IsEmpty(Int32).Queue(Size%3a%20512).html>) | 17.42 ns | 20.87 ns | 1.20 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.IsEmpty<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.Concurrent.IsEmpty<Int32>.Bag(Size: 0)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.49628687933735 > 42.66031169353819.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.692835735081388 (T) = (0 -49.32542605534373) / Math.Sqrt((0.808105722262576 / (21)) + (6.843979545600525 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.20794023727424857 = (40.834326511589644 - 49.32542605534373) / 40.834326511589644 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Concurrent.IsEmpty<Int32>.Bag(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.155131280199946 > 36.32004084980666.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -32.28651550208856 (T) = (0 -43.886761622059055) / Math.Sqrt((0.6688495873822705 / (21)) + (0.649608413373843 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2591182079521939 = (34.85515604879994 - 43.886761622059055) / 34.85515604879994 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 0)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.091624897783635 > 18.78598338241431.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -42.19813845396925 (T) = (0 -19.92350024749442) / Math.Sqrt((0.023832663090482056 / (21)) + (0.017317554193786385 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1150144444850423 = (17.86837860804205 - 19.92350024749442) / 17.86837860804205 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.870839194533986 > 18.30340336300351.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -20.05029828947445 (T) = (0 -19.914443789316213) / Math.Sqrt((0.008011877699379059 / (21)) + (0.20221850294761679 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1397199288683553 = (17.473103071111126 - 19.914443789316213) / 17.473103071111126 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Globalization.Tests.Perf_DateTimeCultureInfo
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring%3a%20ja).html>) | 716.52 ns | 1.16 μs | 1.63 | 0.04 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20).html>) | 288.94 ns | 512.28 ns | 1.77 | 0.04 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20da).html>) | 281.52 ns | 502.47 ns | 1.78 | 0.03 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20fr).html>) | 286.95 ns | 507.72 ns | 1.77 | 0.05 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring%3a%20fr).html>) | 723.75 ns | 1.17 μs | 1.62 | 0.07 | False | |||||
| [ToStringHebrewIsrael - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael.html>) | 464.73 ns | 1.15 μs | 2.47 | 0.05 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring%3a%20).html>) | 732.52 ns | 1.18 μs | 1.62 | 0.05 | False | |||||
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20ja).html>) | 282.16 ns | 507.03 ns | 1.80 | 0.02 | False | |||||
| [Parse - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring%3a%20da).html>) | 729.44 ns | 1.21 μs | 1.66 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_DateTimeCultureInfo*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring: ja)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1647994893300309 > 754.5101578047958.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -115.22101100749308 (T) = (0 -1178.3580061583964) / Math.Sqrt((124.28925317811927 / (21)) + (136.56383388253641 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6316080416308688 = (722.2065447658448 - 1178.3580061583964) / 722.2065447658448 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: )
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 512.2836942539777 > 301.96309881335674.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -174.6506420707438 (T) = (0 -510.25622435319474) / Math.Sqrt((29.619627422416226 / (21)) + (2.372263603215386 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7550843604289853 = (290.730312375683 - 510.25622435319474) / 290.730312375683 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: da)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 502.4684246057463 > 294.80404309205557.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -145.20992978484549 (T) = (0 -504.9964380322562) / Math.Sqrt((18.007775506695626 / (21)) + (21.897174831834494 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8098396537745702 = (279.02827578069935 - 504.9964380322562) / 279.02827578069935 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: fr)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 507.7229360461931 > 302.50633128677623.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -194.26899455623303 (T) = (0 -507.36656318573193) / Math.Sqrt((22.475134866616802 / (21)) + (2.5700062454104207 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7505303722441472 = (289.8359098650185 - 507.36656318573193) / 289.8359098650185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring: fr)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1736073079330296 > 743.2729017123382.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -95.07836433716729 (T) = (0 -1176.396725673637) / Math.Sqrt((118.3100406592821 / (21)) + (250.80971421962207 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6452893301590964 = (715.0090285699973 - 1176.396725673637) / 715.0090285699973 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToStringHebrewIsrael
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.150165821988064 > 498.90107362111456.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -251.63423805158922 (T) = (0 -1155.637575462759) / Math.Sqrt((83.13352978818581 / (21)) + (46.889383511004326 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4309368282453434 = (475.38774436063864 - 1155.637575462759) / 475.38774436063864 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring: )
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1831864604041415 > 762.2501741768.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -134.78707349186442 (T) = (0 -1188.6726838087548) / Math.Sqrt((64.57606245829523 / (21)) + (124.37796437293372 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6451051834637974 = (722.5511753029577 - 1188.6726838087548) / 722.5511753029577 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ja)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 507.0281195227364 > 296.56687978126126.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -219.22336214899371 (T) = (0 -504.7843442603043) / Math.Sqrt((14.422846106714388 / (21)) + (4.5737575979623015 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7768698705698248 = (284.0862758837961 - 504.7843442603043) / 284.0862758837961 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.Parse(culturestring: da)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2116140602563723 > 764.2327996581568.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -109.01558953065339 (T) = (0 -1213.7240696884878) / Math.Sqrt((98.6761757412754 / (21)) + (211.6823215697465 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6662827091812754 = (728.4022471101849 - 1213.7240696884878) / 728.4022471101849 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Collections.ContainsTrueComparer<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ImmutableHashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.ContainsTrueComparer(String).ImmutableHashSet(Size%3a%20512).html>) | 92.80 μs | 129.09 μs | 1.39 | 0.13 | False | |||||
| [HashSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Collections.ContainsTrueComparer(String).HashSet(Size%3a%20512).html>) | 50.40 μs | 85.86 μs | 1.70 | 0.28 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrueComparer<String>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Collections.ContainsTrueComparer<String>.ImmutableHashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 129.092075136612 > 97.58578846104382.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -62.68546995874741 (T) = (0 -128784.1528787916) / Math.Sqrt((3387379.5266809724 / (21)) + (2113243.669122316 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3736105570306795 = (93755.94284684521 - 128784.1528787916) / 93755.94284684521 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.ContainsTrueComparer<String>.HashSet(Size: 512)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.85531669446625 > 52.74608600843313.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -92.01191046944164 (T) = (0 -85975.94462926438) / Math.Sqrt((2715880.365590721 / (21)) + (232016.84498619818 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6914325513130853 = (50830.253067153004 - 85975.94462926438) / 50830.253067153004 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [Base64EncodeInPlace - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64EncodeInPlace(NumberOfBytes%3a%20200000000).html>) | 261.26 ms | 528.16 ms | 2.02 | 0.00 | False | |||||
| [Base64DecodeInPlace - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64DecodeInPlace(NumberOfBytes%3a%20200000000).html>) | 318.36 ms | 455.12 ms | 1.43 | 0.00 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64EncodeInPlace(NumberOfBytes: 200000000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 528.1582003076923 > 274.0710262759616.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -881.001179652871 (T) = (0 -528114010.68320256) / Math.Sqrt((54702184104.41705 / (21)) + (1250440631000.6265 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0233761281000364 = (261006346.44686905 - 528114010.68320256) / 261006346.44686905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64DecodeInPlace(NumberOfBytes: 200000000)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 455.1155326666667 > 334.4808786375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -286.12870010775634 (T) = (0 -452618849.33532184) / Math.Sqrt((11088563523.934832 / (21)) + (3067145747856.523 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4209541203041618 = (318531642.13242626 - 452618849.33532184) / 318531642.13242626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Text.Json.Tests.Perf_Doubles
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20False%2c%20SkipValidation%3a%20False).html>) | 35.83 ms | 86.92 ms | 2.43 | 0.02 | False | |||||
| [WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20True%2c%20SkipValidation%3a%20False).html>) | 38.95 ms | 87.68 ms | 2.25 | 0.03 | False | |||||
| [WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20False%2c%20SkipValidation%3a%20True).html>) | 35.42 ms | 86.08 ms | 2.43 | 0.04 | False | |||||
| [WriteDoubles - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted%3a%20True%2c%20SkipValidation%3a%20True).html>) | 36.13 ms | 87.55 ms | 2.42 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Doubles*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.91815906666666 > 37.42043959000001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -382.41772157804877 (T) = (0 -86667944.38707483) / Math.Sqrt((22335733080.37219 / (21)) + (234203662733.01965 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4305402254375643 = (35657893.45102166 - 86667944.38707483) / 35657893.45102166 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: False)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.67832136666667 > 40.054472770000004.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -193.99902957465886 (T) = (0 -88223142.59380558) / Math.Sqrt((916630367515.431 / (21)) + (367427028914.1049 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3886213207524778 = (36934754.717006795 - 88223142.59380558) / 36934754.717006795 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: False, SkipValidation: True)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.07832423214285 > 37.18470954000001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -213.51598318544595 (T) = (0 -86572089.61224489) / Math.Sqrt((50049834356.03418 / (21)) + (766340454087.5916 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4358128938441268 = (35541354.523179084 - 86572089.61224489) / 35541354.523179084 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Doubles.WriteDoubles(Formatted: True, SkipValidation: True)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.55111278846154 > 39.278785015.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -259.1421693555966 (T) = (0 -88303749.58841574) / Math.Sqrt((368706729152.4009 / (21)) + (315109424187.6714 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4237270944801546 = (36433041.40533004 - 88303749.58841574) / 36433041.40533004 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
naricc
kotlarmilos
Run Information
Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests
Test Report
Repro