performanceautofiler[bot]
commented
2 years ago Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 543bcc5ee7d6a2b9471b016770227421c43a756e |
| Compare | f142128e89b63577a9bbba7e2b760ec82102a7a9 |
| Diff | Diff |
Regressions in System.IO.Tests.StringReaderReadToEndTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20129%2c%201024%5d).html>) | 7.66 ns | 8.76 ns | 1.14 | 0.33 | False | |||||
| [ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%201%2c%20%20%20%201%5d).html>) | 7.47 ns | 8.57 ns | 1.15 | 0.32 | False | |||||
| [ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%209%2c%20%20%2032%5d).html>) | 7.46 ns | 8.77 ns | 1.18 | 0.33 | False | |||||
| [ReadToEnd - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange%3a%20%5b%20%20%200%2c%20%20%20%200%5d).html>) | 7.49 ns | 8.73 ns | 1.17 | 0.35 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StringReaderReadToEndTests*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 129, 1024])
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.76131006765833 > 8.049820476104774.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -9.43518371100435 (T) = (0 -8.750984361458578) / Math.Sqrt((0.09497833884531566 / (20)) + (0.27184392364788257 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.14895102666931792 = (7.6164990137366555 - 8.750984361458578) / 7.6164990137366555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 1])
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.568588229585673 > 7.979486053488133.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -9.702617577044641 (T) = (0 -8.544884027333483) / Math.Sqrt((0.05124525832486074 / (20)) + (0.1842099940006118 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.12178498984731792 = (7.617220861991116 - 8.544884027333483) / 7.617220861991116 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 9, 32])
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.770260350229156 > 7.943006921371798.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -6.347909560582415 (T) = (0 -8.624392469903274) / Math.Sqrt((0.20843347538331014 / (20)) + (0.22310968446432108 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.11088157674510427 = (7.763557025738821 - 8.624392469903274) / 7.763557025738821 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0])
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.732099082937193 > 8.117739891261323.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -11.099368981960703 (T) = (0 -8.410675108476925) / Math.Sqrt((0.03168942928413268 / (20)) + (0.11153009321834963 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.10922570164830957 = (7.582474059137523 - 8.410675108476925) / 7.582474059137523 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | 543bcc5ee7d6a2b9471b016770227421c43a756e |
| Compare | f142128e89b63577a9bbba7e2b760ec82102a7a9 |
| Diff | Diff |
Regressions in PerfLabTests.CastingPerf2.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| [FooObjCastIfIsa - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa.html>) | 261.01 μs | 368.57 μs | 1.41 | 0.03 | False | |||||
| [IFooObjIsDescendantOfIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo.html>) | 455.77 μs | 497.02 μs | 1.09 | 0.01 | False | |||||
| [FooObjIsDescendant - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant.html>) | 413.39 μs | 480.97 μs | 1.16 | 0.03 | False | |||||
| [FooObjIsFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo.html>) | 348.82 μs | 512.07 μs | 1.47 | 0.00 | False | |||||
| [IFooFooIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo.html>) | 261.08 μs | 488.12 μs | 1.87 | 0.01 | False | |||||
| [ObjScalarValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.ObjScalarValueType.html>) | 523.28 μs | 732.14 μs | 1.40 | 0.24 | False | |||||
| [ObjInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.ObjInt.html>) | 472.34 μs | 710.55 μs | 1.50 | 0.28 | False | |||||
| [FooObjIsNull - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull.html>) | 304.37 μs | 349.44 μs | 1.15 | 0.02 | False | |||||
| [ObjFooIsObj - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj.html>) | 261.23 μs | 483.13 μs | 1.85 | 0.00 | False | |||||
| [IFooObjIsIFoo - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo.html>) | 455.30 μs | 497.34 μs | 1.09 | 0.01 | False | |||||
| [IFooObjIsIFooInterAlia - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia.html>) | 326.10 μs | 397.66 μs | 1.22 | 0.01 | False | |||||
| [ObjObjrefValueType - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/PerfLabTests.CastingPerf2.CastingPerf.ObjObjrefValueType.html>) | 865.90 μs | 1.09 ms | 1.26 | 0.39 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
### Payloads
[Baseline]()
[Compare]()
### Histogram
#### PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 368.56541521317826 > 274.1401056640625.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -52.88026820375002 (T) = (0 -367462.90329131467) / Math.Sqrt((98208676.94042994 / (20)) + (2360259.3813489247 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.474088888920203 = (249281.37377148806 - 367462.90329131467) / 249281.37377148806 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 497.01799834735573 > 478.57215954910714.
IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -17.818088370875728 (T) = (0 -496473.25921291485) / Math.Sqrt((206058859.63131377 / (20)) + (5880164.448888213 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.13169075607836297 = (438700.463484688 - 496473.25921291485) / 438700.463484688 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 480.9705628676472 > 434.13126535083165.
IsChangePoint: Marked as a change because one of 6/14/2022 6:55:13 PM, 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 7/28/2022 3:42:13 AM, 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -21.333398296796346 (T) = (0 -481536.0160926357) / Math.Sqrt((358867245.60058457 / (20)) + (3051570.1419064677 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.23188211436042155 = (390894.5592108409 - 481536.0160926357) / 390894.5592108409 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 512.0733505184332 > 365.57931401041674.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -414.45283598993603 (T) = (0 -513804.06861144485) / Math.Sqrt((94201.28277612598 / (20)) + (4341271.671204187 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.4758137897214457 = (348149.6596589082 - 513804.06861144485) / 348149.6596589082 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.IFooFooIsIFoo
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 488.12399244791663 > 274.1410765594953.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -199.85480244199283 (T) = (0 -483201.8490744225) / Math.Sqrt((23113.166371036652 / (20)) + (34549692.3789632 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.850670817787682 = (261095.51435627477 - 483201.8490744225) / 261095.51435627477 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.ObjScalarValueType
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 732.1447409090908 > 549.7332502265625.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -27.575207919049724 (T) = (0 -688567.6938276673) / Math.Sqrt((533636526.1503296 / (20)) + (573753810.8588315 / (27))) is less than -2.0141033888794695 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (27) - 2, .025) and -0.383620453421684 = (497656.4867372725 - 688567.6938276673) / 497656.4867372725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.ObjInt
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 710.5534788043478 > 496.965320841689.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -16.162180807699166 (T) = (0 -673798.6896152856) / Math.Sqrt((1467152776.446148 / (20)) + (1523816395.9236093 / (27))) is less than -2.0141033888794695 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (27) - 2, .025) and -0.37603555407132633 = (489666.6278874067 - 673798.6896152856) / 489666.6278874067 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsNull
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 349.4418973148148 > 319.84465647435894.
IsChangePoint: Marked as a change because one of 8/17/2022 6:09:21 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -30.38161481114196 (T) = (0 -356900.27133593103) / Math.Sqrt((11632599.143247847 / (21)) + (62610026.58049485 / (27))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (27) - 2, .025) and -0.1686121288646668 = (305405.2431260214 - 356900.27133593103) / 305405.2431260214 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.ObjFooIsObj
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 483.13420909090905 > 274.2652532083333.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -338.7294140728009 (T) = (0 -482672.9416644176) / Math.Sqrt((77149.87340037803 / (20)) + (11860407.67321067 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.8478030938544573 = (261214.48939539198 - 482672.9416644176) / 261214.48939539198 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 497.3414763824885 > 478.2361264169408.
IsChangePoint: Marked as a change because one of 7/6/2022 7:05:00 PM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -18.52617972451439 (T) = (0 -497247.84693631105) / Math.Sqrt((191964700.13409176 / (20)) + (5682943.436212246 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.1320430232329927 = (439248.1882148126 - 497247.84693631105) / 439248.1882148126 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 397.65637835365857 > 342.51951726875.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -183.39266093224066 (T) = (0 -399003.07972696924) / Math.Sqrt((22161.74686090346 / (20)) + (4377798.39559168 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.22306890528607076 = (326231.0716939076 - 399003.07972696924) / 326231.0716939076 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.ObjObjrefValueType
```log
```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0909231733974358 > 895.3416228353436.
IsChangePoint: Marked as a change because one of 6/13/2022 2:27:15 PM, 8/5/2022 10:47:59 PM, 8/23/2022 7:19:33 AM falls between 8/5/2022 10:47:59 PM and 8/23/2022 7:19:33 AM.
IsRegressionStdDev: Marked as regression because -13.355138203235018 (T) = (0 -988781.4509650823) / Math.Sqrt((683025627.949915 / (20)) + (2020897328.5271063 / (28))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (28) - 2, .025) and -0.16180911093155365 = (851070.4914099567 - 988781.4509650823) / 851070.4914099567 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```
### Docs
[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
_1.png>)
_1.png>)
_1.png>)
_2.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_1.png>)
_2.png>)
_3.png>)
_4.png>)
_5.png>)
_6.png>)
_7.png>)
_8.png>)
_9.png>)
_10.png>)
_1.png>)
_2.png>)
_3.png>)
_1.png>)
_1.png>)
_2.png>)
_1.png>)
_2.png>)
_1.png>)
_1.png>)
_2.png>)
_3.png>)
_1.png>)
_1.png>)
Run Information
Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common
Repro