performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 0b7fd637e93a02942eac1cec903d836194fceb86 |
| Diff | Diff |
Improvements in System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromString(Mode%3a%20Reflection).html>) | 2.35 μs | 2.10 μs | 0.90 | 0.14 | False | |||||
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromUtf8Bytes(Mode%3a%20SourceGen).html>) | 1.81 μs | 1.61 μs | 0.89 | 0.15 | False | |||||
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromReader(Mode%3a%20SourceGen).html>) | 2.75 μs | 2.48 μs | 0.90 | 0.14 | False | |||||
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromReader(Mode%3a%20Reflection).html>) | 3.07 μs | 2.73 μs | 0.89 | 0.25 | False | |||||
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromString(Mode%3a%20SourceGen).html>) | 2.22 μs | 1.94 μs | 0.87 | 0.10 | False | |||||
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(LoginViewModel).DeserializeFromUtf8Bytes(Mode%3a%20Reflection).html>) | 2.09 μs | 1.78 μs | 0.85 | 0.19 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromString(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.1045023610922735 < 2.3026201968105893.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 15.2490429513446 (T) = (0 -2196.877809740459) / Math.Sqrt((3510.5259260302623 / (66)) + (3897.6371188456055 / (16))) is greater than 1.990063421253899 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (16) - 2, .975) and 0.10680885681098456 = (2459.5830651620777 - 2196.877809740459) / 2459.5830651620777 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromUtf8Bytes(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.6135802464837166 < 1.7385231008049224.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 24.77890295366895 (T) = (0 -1577.4156320862762) / Math.Sqrt((2273.985556413262 / (63)) + (1412.0595277189163 / (16))) is greater than 1.9912543953879198 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (63) + (16) - 2, .975) and 0.14905837389978766 = (1853.7295434886971 - 1577.4156320862762) / 1853.7295434886971 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromReader(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.475639765702761 < 2.6062743561719404.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 14.039976140036636 (T) = (0 -2455.794131926231) / Math.Sqrt((3918.6197522959565 / (67)) + (6677.383459950452 / (16))) is greater than 1.9896863234564313 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (16) - 2, .975) and 0.11088100785261118 = (2762.0533962445547 - 2455.794131926231) / 2762.0533962445547 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromReader(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.732702652180275 < 2.879122723412854.
IsChangePoint: Marked as a change because one of 12/10/2022 12:36:40 AM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 15.337691695930557 (T) = (0 -2722.432073655238) / Math.Sqrt((9010.66550537756 / (69)) + (3685.4676440609564 / (12))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (69) + (12) - 2, .975) and 0.10544023587124982 = (3043.3205055972203 - 2722.432073655238) / 3043.3205055972203 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromString(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.941468793593117 < 2.0723737357586534.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 20.086508249206915 (T) = (0 -1933.4721069492623) / Math.Sqrt((2973.5049460764867 / (67)) + (2127.745208042863 / (15))) is greater than 1.990063421253899 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (15) - 2, .975) and 0.1241687238207826 = (2207.585136013828 - 1933.4721069492623) / 2207.585136013828 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromUtf8Bytes(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.781442673093946 < 1.952208674650901.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 13.327604640444031 (T) = (0 -1848.0166581796163) / Math.Sqrt((2634.8044064983196 / (65)) + (3991.016134599354 / (16))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (16) - 2, .975) and 0.10937556868743471 = (2074.967397263161 - 1848.0166581796163) / 2074.967397263161 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 0b7fd637e93a02942eac1cec903d836194fceb86 |
| Diff | Diff |
Improvements in MicroBenchmarks.Serializers.Json_ToString<LoginViewModel>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [JsonNet_ - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/MicroBenchmarks.Serializers.JsonToString(LoginViewModel).JsonNet.html>) | 3.94 μs | 3.33 μs | 0.84 | 0.25 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToString<LoginViewModel>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### MicroBenchmarks.Serializers.Json_ToString<LoginViewModel>.JsonNet_
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.327333288980552 < 4.049745700827987.
IsChangePoint: Marked as a change because one of 11/22/2022 11:24:47 AM, 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 6.572887313656482 (T) = (0 -3422.7969465579667) / Math.Sqrt((160659.5461822662 / (299)) + (5346.229413550522 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.053647825225050974 = (3616.832124226838 - 3422.7969465579667) / 3616.832124226838 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 91af060b086ab83ba3200fbc7049854900b08523 |
| Diff | Diff |
Improvements in System.Text.Json.Serialization.Tests.ReadJson<BinaryData>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromUtf8Bytes(Mode%3a%20Reflection).html>) | 3.63 μs | 3.28 μs | 0.90 | 0.01 | False | |||||
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromUtf8Bytes(Mode%3a%20SourceGen).html>) | 3.50 μs | 3.11 μs | 0.89 | 0.01 | False | |||||
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromString(Mode%3a%20SourceGen).html>) | 4.45 μs | 4.13 μs | 0.93 | 0.01 | False | |||||
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromString(Mode%3a%20Reflection).html>) | 4.65 μs | 4.20 μs | 0.90 | 0.01 | False | |||||
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromReader(Mode%3a%20Reflection).html>) | 5.53 μs | 5.12 μs | 0.93 | 0.02 | False | |||||
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(BinaryData).DeserializeFromReader(Mode%3a%20SourceGen).html>) | 5.31 μs | 4.84 μs | 0.91 | 0.04 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<BinaryData>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromUtf8Bytes(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.2838283806680963 < 3.443009602859142.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 35.21844435067335 (T) = (0 -3313.8140024665745) / Math.Sqrt((2085.259326976406 / (67)) + (879.8584585155033 / (14))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (14) - 2, .975) and 0.09340120877647377 = (3655.2155535022525 - 3313.8140024665745) / 3655.2155535022525 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromUtf8Bytes(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.106881187421258 < 3.305724730372391.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 46.38443280904661 (T) = (0 -3115.443894539693) / Math.Sqrt((1442.8674738404059 / (67)) + (658.3142534908536 / (16))) is greater than 1.9896863234564313 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (16) - 2, .975) and 0.10544451867647077 = (3482.6726341559875 - 3115.443894539693) / 3482.6726341559875 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.131168704096982 < 4.257825142864762.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 38.64681128337273 (T) = (0 -4073.21076893374) / Math.Sqrt((2284.5401720951263 / (63)) + (1296.965054261252 / (16))) is greater than 1.9912543953879198 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (63) + (16) - 2, .975) and 0.09319293621045308 = (4491.816320785803 - 4073.21076893374) / 4491.816320785803 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromString(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.200914245999457 < 4.429234792167232.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 23.57457141301205 (T) = (0 -4285.4166933342785) / Math.Sqrt((2818.860964340446 / (65)) + (3343.3212404943947 / (16))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (16) - 2, .975) and 0.08036145153236816 = (4659.892411507705 - 4285.4166933342785) / 4659.892411507705 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromReader(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.120789724403009 < 5.235585576820923.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 31.596340627635712 (T) = (0 -5037.281283715933) / Math.Sqrt((6189.525261600865 / (67)) + (1714.4882454840988 / (16))) is greater than 1.9896863234564313 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (16) - 2, .975) and 0.08139204320647196 = (5483.602930350126 - 5037.281283715933) / 5483.602930350126 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<BinaryData>.DeserializeFromReader(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.836989456018518 < 5.005027522868834.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 38.86241487778069 (T) = (0 -4814.220227644805) / Math.Sqrt((4830.127560528712 / (67)) + (1212.5756005504654 / (16))) is greater than 1.9896863234564313 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (16) - 2, .975) and 0.08938967337168974 = (5286.80609791707 - 4814.220227644805) / 5286.80609791707 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 0b7fd637e93a02942eac1cec903d836194fceb86 |
| Diff | Diff |
Improvements in System.Text.Json.Serialization.Tests.ReadJson<Nullable<DateTimeOffset>>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Nullable(DateTimeOffset)).DeserializeFromReader(Mode%3a%20SourceGen).html>) | 1.80 μs | 1.58 μs | 0.88 | 0.27 | False |
_1.png>)
Test Report.html>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<Nullable<DateTimeOffset>>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Serialization.Tests.ReadJson<Nullable<DateTimeOffset>>.DeserializeFromReader(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.5801725155070119 < 1.657809610030493.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 5.042458474848967 (T) = (0 -1636.441027216518) / Math.Sqrt((3167.6824944792916 / (65)) + (4996.092394544446 / (16))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (16) - 2, .975) and 0.05530697141663305 = (1732.2463252115615 - 1636.441027216518) / 1732.2463252115615 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 91af060b086ab83ba3200fbc7049854900b08523 |
| Diff | Diff |
Improvements in System.Text.Json.Serialization.Tests.ReadJson<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromReader(Mode%3a%20SourceGen).html>) | 1.10 μs | 716.33 ns | 0.65 | 0.17 | False | |||||
| [DeserializeFromReader - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromReader(Mode%3a%20Reflection).html>) | 1.11 μs | 712.24 ns | 0.64 | 0.08 | False | |||||
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromString(Mode%3a%20SourceGen).html>) | 919.73 ns | 549.43 ns | 0.60 | 0.31 | False | |||||
| [DeserializeFromString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromString(Mode%3a%20Reflection).html>) | 904.76 ns | 545.41 ns | 0.60 | 0.13 | False | |||||
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromUtf8Bytes(Mode%3a%20Reflection).html>) | 680.40 ns | 337.50 ns | 0.50 | 0.18 | False | |||||
| [DeserializeFromUtf8Bytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Text.Json.Serialization.Tests.ReadJson(Int32).DeserializeFromUtf8Bytes(Mode%3a%20SourceGen).html>) | 662.88 ns | 338.37 ns | 0.51 | 0.18 | False |
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson<Int32>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromReader(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 716.3275258816042 < 1.0370064801429684.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 80.44020616475542 (T) = (0 -723.7634337075579) / Math.Sqrt((1002.3822030492747 / (66)) + (102.35950082698137 / (15))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (15) - 2, .975) and 0.3427267811528331 = (1101.1606938390285 - 723.7634337075579) / 1101.1606938390285 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromReader(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 712.2394394503709 < 1.0269704092997878.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 107.77510909808068 (T) = (0 -719.0531345820207) / Math.Sqrt((577.516090946751 / (65)) + (58.28188404359194 / (16))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (16) - 2, .975) and 0.34662082233854224 = (1100.514309555471 - 719.0531345820207) / 1100.514309555471 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromString(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 549.4340193227956 < 871.6268320390755.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 54.75366670915209 (T) = (0 -569.1438769650011) / Math.Sqrt((1253.3519657631157 / (65)) + (412.27289126915485 / (16))) is greater than 1.9904502102296528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (16) - 2, .975) and 0.39235848716330785 = (936.6441642672338 - 569.1438769650011) / 936.6441642672338 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromString(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 545.4068830360086 < 866.4054783575635.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 70.24922334993877 (T) = (0 -569.4167736658823) / Math.Sqrt((1187.3712958643068 / (66)) + (181.58518623321828 / (16))) is greater than 1.990063421253899 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (16) - 2, .975) and 0.40056891459048677 = (949.9286699101931 - 569.4167736658823) / 949.9286699101931 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromUtf8Bytes(Mode: Reflection)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 337.4960458815277 < 654.521041610768.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 117.43974318932192 (T) = (0 -337.8977646708228) / Math.Sqrt((389.5250508743521 / (64)) + (58.35239025888881 / (16))) is greater than 1.9908470688111533 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (64) + (16) - 2, .975) and 0.5202292605273624 = (704.290063713012 - 337.8977646708228) / 704.290063713012 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Serialization.Tests.ReadJson<Int32>.DeserializeFromUtf8Bytes(Mode: SourceGen)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 338.3710854823412 < 660.2501430659984.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 85.8293693779937 (T) = (0 -342.54719962425435) / Math.Sqrt((895.0489579139692 / (66)) + (58.96415052821514 / (16))) is greater than 1.990063421253899 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (16) - 2, .975) and 0.5099385689464068 = (698.9882857906304 - 342.54719962425435) / 698.9882857906304 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 0b7fd637e93a02942eac1cec903d836194fceb86 |
| Diff | Diff |
Improvements in MicroBenchmarks.Serializers.Json_FromStream<LoginViewModel>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [SystemTextJsonReflection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/MicroBenchmarks.Serializers.Json_FromStream(LoginViewModel).SystemTextJsonReflection.html>) | 2.44 μs | 2.13 μs | 0.87 | 0.18 | False |
_1.png>)
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream<LoginViewModel>*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### MicroBenchmarks.Serializers.Json_FromStream<LoginViewModel>.SystemTextJson_Reflection_
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.1344018630928026 < 2.283303056609905.
IsChangePoint: Marked as a change because one of 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 14.05730687189653 (T) = (0 -2191.6845415700896) / Math.Sqrt((4995.1027523500425 / (67)) + (3451.3739007784507 / (16))) is greater than 1.9896863234564313 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (67) + (16) - 2, .975) and 0.09851035646197316 = (2431.181053803908 - 2191.6845415700896) / 2431.181053803908 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 9333e468a9bc61950f3c7b25d52338dfd956ce78 |
| Compare | 0b7fd637e93a02942eac1cec903d836194fceb86 |
| Diff | Diff |
Improvements in System.Tests.Perf_Int32
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_AOT=true_CompliationMode=wasm_RunKind=micro/System.Tests.Perf_Int32.ToString(value%3a%204).html>) | 20.21 ns | 16.18 ns | 0.80 | 0.57 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Tests.Perf_Int32.ToString(value: 4)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.18162404328531 < 19.066600497229743.
IsChangePoint: Marked as a change because one of 12/1/2022 11:48:13 PM, 12/9/2022 1:52:32 PM, 12/13/2022 5:38:37 AM falls between 12/4/2022 6:53:17 AM and 12/13/2022 5:38:37 AM.
IsImprovementStdDev: Marked as improvement because 6.1711713847096386 (T) = (0 -16.395198737800886) / Math.Sqrt((3.948926431593984 / (299)) + (0.2560254733101372 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.060440932156783006 = (17.449886120982796 - 16.395198737800886) / 17.449886120982796 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_1.png>)
_1.png>)
_2.png>)
_1.png>)
_1.png>)
Run Information
Improvements in System.Text.Encodings.Web.Tests.Perf_Encoders
Repro
Run Information
Improvements in System.Collections.Sort<BigStruct>
Repro
Run Information
Improvements in System.Text.Json.Serialization.Tests.ReadJson<Location>
Repro
Run Information
Improvements in System.Tests.Perf_String
Repro
Run Information
Improvements in System.Reflection.Invoke
Repro
Run Information
Improvements in System.Collections.Tests.Perf_BitArray
Repro
Run Information
Improvements in System.Text.Json.Document.Tests.Perf_ParseThenWrite
Repro