performanceautofiler[bot]
commented
1 year ago Run Information
| Architecture | arm64 |
|---|---|
| OS | ubuntu 20.04 |
| Baseline | 524045bb01369c26a0dfc349c1c6a8e26a8a9833 |
| Compare | 75f9609c5bb962d86afae1952536813a95b4a6d7 |
| Diff | Diff |
Regressions in System.Text.Json.Tests.Perf_Segment
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json4KB).html>) | 13.30 μs | 20.05 μs | 1.51 | 0.01 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json4KB).html>) | 13.23 μs | 19.89 μs | 1.50 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json4KB).html>) | 13.47 μs | 21.94 μs | 1.63 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json40KB).html>) | 131.79 μs | 216.14 μs | 1.64 | 0.02 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json400KB).html>) | 1.33 ms | 1.97 ms | 1.49 | 0.01 | False | |||||
| [ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json4KB).html>) | 13.22 μs | 19.84 μs | 1.50 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%208192%2c%20TestCase%3a%20Json400KB).html>) | 1.33 ms | 2.17 ms | 1.63 | 0.02 | False | |||||
| [ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json400KB).html>) | 1.31 ms | 1.98 ms | 1.51 | 0.01 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json40KB).html>) | 130.14 μs | 194.07 μs | 1.49 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json4KB).html>) | 13.61 μs | 22.24 μs | 1.63 | 0.02 | False | |||||
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json4KB).html>) | 14.51 μs | 23.61 μs | 1.63 | 0.01 | False | |||||
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json400KB).html>) | 1.45 ms | 2.35 ms | 1.63 | 0.01 | False | |||||
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json400KB).html>) | 1.43 ms | 2.32 ms | 1.62 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json400KB).html>) | 1.35 ms | 2.19 ms | 1.63 | 0.01 | False | |||||
| [ReadSingleSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase%3a%20Json40KB).html>) | 130.35 μs | 194.32 μs | 1.49 | 0.04 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%208192%2c%20TestCase%3a%20Json4KB).html>) | 13.13 μs | 19.84 μs | 1.51 | 0.01 | False | |||||
| [ReadMultiSegmentSequenceUsingSpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize%3a%204096%2c%20TestCase%3a%20Json40KB).html>) | 132.55 μs | 218.32 μs | 1.65 | 0.01 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json400KB).html>) | 1.34 ms | 1.98 ms | 1.47 | 0.01 | False | |||||
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%208192%2c%20TestCase%3a%20Json40KB).html>) | 140.86 μs | 228.72 μs | 1.62 | 0.01 | False | |||||
| [ReadMultiSegmentSequence - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize%3a%204096%2c%20TestCase%3a%20Json40KB).html>) | 142.88 μs | 230.05 μs | 1.61 | 0.01 | False | |||||
| [ReadSingleSegmentSequenceByN - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=true_MonoInterpreter=false/System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes%3a%204096%2c%20TestCase%3a%20Json40KB).html>) | 132.62 μs | 198.85 μs | 1.50 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Segment*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.05179020700637 > 13.962653266763905.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -217.73457894485912 (T) = (0 -19944.51655577445) / Math.Sqrt((9996.928403273914 / (21)) + (6221.936755754028 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49524595661404935 = (13338.619287049174 - 19944.51655577445) / 13338.619287049174 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.88644475941517 > 13.903558027783395.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.73099872454978 (T) = (0 -20001.167359116553) / Math.Sqrt((11280.158876927571 / (21)) + (10027.129020000586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5056452554233557 = (13284.116751321111 - 20001.167359116553) / 13284.116751321111 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.940110378681627 > 14.24616351173867.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -259.3464792887817 (T) = (0 -21875.67403100655) / Math.Sqrt((16324.388018406451 / (21)) + (3565.0389178009095 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6151272563692368 = (13544.241758499256 - 21875.67403100655) / 13544.241758499256 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 216.14172602739725 > 138.10853811825982.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -239.1495723396819 (T) = (0 -214291.60449344633) / Math.Sqrt((1199694.9998831865 / (21)) + (850669.9273145547 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6212207579145996 = (132179.16403259776 - 214291.60449344633) / 132179.16403259776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9734660020833334 > 1.3928393788020834.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -211.24037445689305 (T) = (0 -1982244.0237856081) / Math.Sqrt((85265860.47889756 / (21)) + (78100514.75346646 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4944368482067808 = (1326415.382599915 - 1982244.0237856081) / 1326415.382599915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.844480089662447 > 13.880458925049547.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -218.1812282059725 (T) = (0 -19868.43917323849) / Math.Sqrt((9837.040175256174 / (21)) + (6277.992948000548 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4981499402469478 = (13261.98308959881 - 19868.43917323849) / 13261.98308959881 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1679278208333335 > 1.3996404019791666.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -225.9399535679069 (T) = (0 -2157314.013699777) / Math.Sqrt((107785459.81741878 / (21)) + (111433859.06055655 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6101856189579714 = (1339792.1260133218 - 2157314.013699777) / 1339792.1260133218 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9839560088541666 > 1.3821044633593749.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -162.63300763905036 (T) = (0 -1969478.114243197) / Math.Sqrt((226393816.995681 / (21)) + (71729905.65170242 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49101670422582316 = (1320896.0762554328 - 1969478.114243197) / 1320896.0762554328 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.06709352954147 > 136.3719308961777.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -167.31664734917243 (T) = (0 -196228.4078614817) / Math.Sqrt((1329774.057945638 / (21)) + (1273310.1982364936 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.503546403000965 = (130510.37697927024 - 196228.4078614817) / 130510.37697927024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.237619001116073 > 14.50140462902704.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -221.3261716277037 (T) = (0 -22156.551376739488) / Math.Sqrt((15185.899110004742 / (21)) + (10291.911074578928 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6167131937559469 = (13704.688909765995 - 22156.551376739488) / 13704.688909765995 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.609475339879154 > 15.265649012440994.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -321.39400992908816 (T) = (0 -23430.417835922297) / Math.Sqrt((5137.0463724511155 / (21)) + (7274.8286522790195 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6108421246541109 = (14545.44643284233 - 23430.417835922297) / 14545.44643284233 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.3532333255952382 > 1.5135888100852273.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -348.4482186318647 (T) = (0 -2334397.837424703) / Math.Sqrt((59050496.101819396 / (21)) + (53771652.07292564 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6260246914771751 = (1435647.2258142652 - 2334397.837424703) / 1435647.2258142652 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.317401645408163 > 1.4973947045312497.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -460.8337177360483 (T) = (0 -2314529.820845246) / Math.Sqrt((20443515.090499096 / (21)) + (38599497.266199544 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6248704714978363 = (1424439.5854591834 - 2314529.820845246) / 1424439.5854591834 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1942296765625002 > 1.4129859564843752.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -172.16919878674187 (T) = (0 -2185219.693076371) / Math.Sqrt((102484821.01171705 / (21)) + (259767019.79700407 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6165817316049232 = (1351753.3016452629 - 2185219.693076371) / 1351753.3016452629 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.32315787037035 > 136.08285360278927.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -182.12962330433047 (T) = (0 -194835.90138564055) / Math.Sqrt((1155733.7558286393 / (21)) + (985290.5786590577 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4948613192419298 = (130337.10811678854 - 194835.90138564055) / 130337.10811678854 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json4KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.835687181933846 > 13.817540363445712.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -191.41698962340394 (T) = (0 -19901.800480164162) / Math.Sqrt((7174.73085631977 / (21)) + (12396.786175730664 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5081279903514462 = (13196.36039347453 - 19901.800480164162) / 13196.36039347453 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 218.32299594907408 > 139.02603790020567.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -225.25817429402167 (T) = (0 -216261.02234458804) / Math.Sqrt((955737.3526735405 / (21)) + (1273994.8527746832 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6256069760718382 = (133034.0146959551 - 216261.02234458804) / 133034.0146959551 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json400KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9800831161458334 > 1.400740612578125.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -175.54147882745713 (T) = (0 -1992058.2385735544) / Math.Sqrt((86987159.23406735 / (21)) + (137560248.4864252 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4910685118148826 = (1335993.767415075 - 1992058.2385735544) / 1335993.767415075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 228.7219004830918 > 147.87764158906955.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -438.71034455593843 (T) = (0 -228992.7190603687) / Math.Sqrt((325694.52775819314 / (21)) + (350873.0713814378 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6283819098939206 = (140625.92913187435 - 228992.7190603687) / 140625.92913187435 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 230.05102686651583 > 149.86013101420454.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -365.9439890926763 (T) = (0 -231090.11926535034) / Math.Sqrt((459845.2454151561 / (21)) + (523421.0995238739 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6275270591388461 = (141988.49596247223 - 231090.11926535034) / 141988.49596247223 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json40KB)
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 198.8522930040687 > 138.88419429440046.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -130.7664041979499 (T) = (0 -197403.2917513144) / Math.Sqrt((1337882.9268764032 / (21)) + (2686839.0575929983 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.503583816058525 = (131288.5185667832 - 197403.2917513144) / 131288.5185667832 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests
Test Report
Repro