search

DrewScoggins / performance-2

This repo contains benchmarks used for testing the performance of all .NET Runtimes
MIT License
0 stars 0 forks source link

[Perf] Linux/x64: 2598 Improvements on 8/23/2023 2:33:13 PM #8886

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.ContainsFalse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.39 ms 10.01 ms 0.75 0.00 True
4.87 ms 4.30 ms 0.88 0.00 True
13.14 ms 10.29 ms 0.78 0.00 True
13.57 ms 11.01 ms 0.81 0.00 True
30.51 ms 21.53 ms 0.71 0.00 True
2.37 ms 1.96 ms 0.83 0.00 True
2.48 ms 2.10 ms 0.85 0.00 True
13.65 ms 11.05 ms 0.81 0.00 True
13.44 ms 9.91 ms 0.74 0.00 True
12.81 ms 10.07 ms 0.79 0.00 True
13.41 ms 10.94 ms 0.82 0.00 True
88.71 μs 73.47 μs 0.83 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse&lt;String&gt;*'
### System.Collections.ContainsFalse<String>.Array(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.011106739583333 < 12.236100962377025. IsImprovementStdDev: Marked as improvement because 17.832328933041477 (TBase) = (13013691.327114554 -10238062.535) / Math.Sqrt((41747887352.604095 / (19)) + (110150665060.57175 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.21328527950647014 = (13013691.327114554 - 10238062.535) / 13013691.327114554 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.Span(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.296408051724137 < 4.5488075505499355. IsImprovementStdDev: Marked as improvement because 12.508529711144375 (TBase) = (4809418.193776137 -4364596.582756743) / Math.Sqrt((2247133264.4854198 / (19)) + (5731737238.407935 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.09248969274392431 = (4809418.193776137 - 4364596.582756743) / 4809418.193776137 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.List(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.29082209735577 < 12.315269166884919. IsImprovementStdDev: Marked as improvement because 13.646831583890235 (TBase) = (13193881.658034047 -10171496.056733059) / Math.Sqrt((690027382612.8958 / (19)) + (63662190735.33681 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.2290747847856124 = (13193881.658034047 - 10171496.056733059) / 13193881.658034047 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.LinkedList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.0116770875 < 13.102687054452614. IsImprovementStdDev: Marked as improvement because 21.321903534567408 (TBase) = (13682748.73499397 -10800257.967142856) / Math.Sqrt((177713936937.319 / (19)) + (44613753598.52348 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.21066606013739567 = (13682748.73499397 - 10800257.967142856) / 13682748.73499397 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.ImmutableList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 21.525616870129873 < 29.36248690829613. IsImprovementStdDev: Marked as improvement because 21.22390050073878 (TBase) = (31029719.707767855 -22613345.737541124) / Math.Sqrt((184752408675.69604 / (19)) + (737647226233.9482 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.27123590059757485 = (31029719.707767855 - 22613345.737541124) / 31029719.707767855 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.SortedSet(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.9633515625 < 2.242237257329932. IsImprovementStdDev: Marked as improvement because 12.806891162176733 (TBase) = (2365918.0540894 -2004060.695364011) / Math.Sqrt((2272946899.4322414 / (19)) + (3393551396.56375 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15294585461230673 = (2365918.0540894 - 2004060.695364011) / 2365918.0540894 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.ImmutableSortedSet(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 2.096738279575893 < 2.33454260234375. IsImprovementStdDev: Marked as improvement because 26.475832961874925 (TBase) = (2468112.0486075683 -2052929.6491889884) / Math.Sqrt((1154174570.0895667 / (19)) + (925826685.0118369 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16821861862098716 = (2468112.0486075683 - 2052929.6491889884) / 2468112.0486075683 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.ImmutableArray(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.051602050000001 < 12.336635989757832. IsImprovementStdDev: Marked as improvement because 11.064931977610037 (TBase) = (12995989.35862675 -10636144.533592034) / Math.Sqrt((64983332381.59874 / (19)) + (210324749691.12485 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18158254519254804 = (12995989.35862675 - 10636144.533592034) / 12995989.35862675 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.Queue(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 9.906060096153846 < 12.506447776223544. IsImprovementStdDev: Marked as improvement because 20.98283135595836 (TBase) = (13055927.882157102 -10259313.381181318) / Math.Sqrt((48976293439.65352 / (19)) + (75930738008.8317 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.21420266152034895 = (13055927.882157102 - 10259313.381181318) / 13055927.882157102 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.Stack(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.074437466517857 < 12.224522879414682. IsImprovementStdDev: Marked as improvement because 9.790338594051327 (TBase) = (12979569.915024605 -10352154.865968406) / Math.Sqrt((51394956309.1317 / (19)) + (346582329167.8571 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.2024269730243383 = (12979569.915024605 - 10352154.865968406) / 12979569.915024605 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.ICollection(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.94164950892857 < 12.308572551972933. IsImprovementStdDev: Marked as improvement because 10.22476188362536 (TBase) = (12999135.36428526 -10509040.09499008) / Math.Sqrt((43397315434.1753 / (19)) + (285128012776.7227 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.19155853058786074 = (12999135.36428526 - 10509040.09499008) / 12999135.36428526 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.ContainsFalse<String>.HashSet(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 73.46986087357477 < 84.57387113158651. IsImprovementStdDev: Marked as improvement because 22.047948534798063 (TBase) = (89496.35363342917 -74036.29160099702) / Math.Sqrt((1520518.4426598519 / (19)) + (2058283.654427177 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17274516116886154 = (89496.35363342917 - 74036.29160099702) / 89496.35363342917 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Text.Json.Document.Tests.Perf_ParseThenWrite

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
347.71 μs 300.37 μs 0.86 0.00 True
62.30 μs 52.85 μs 0.85 0.00 True
597.72 μs 494.05 μs 0.83 0.00 True
49.00 ms 40.62 ms 0.83 0.00 True
487.20 μs 402.29 μs 0.83 0.00 True
523.51 μs 437.10 μs 0.83 0.00 True
105.03 μs 85.55 μs 0.81 0.00 True
122.62 μs 95.66 μs 0.78 0.00 True
296.32 μs 251.34 μs 0.85 0.00 True
99.08 μs 82.92 μs 0.84 0.00 True
67.93 μs 58.42 μs 0.86 0.00 True
9.32 μs 8.05 μs 0.86 0.00 True
45.26 ms 38.02 ms 0.84 0.00 True
535.76 μs 441.07 μs 0.82 0.00 True
10.20 μs 8.65 μs 0.85 0.00 True
90.31 μs 75.50 μs 0.84 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_ParseThenWrite*'
### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 300.36681373559446 < 323.86125650449674. IsImprovementStdDev: Marked as improvement because 18.289389149307468 (TBase) = (340300.74855768715 -294015.99001645815) / Math.Sqrt((10976629.450057212 / (19)) + (29133350.979851123 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13601133332030535 = (340300.74855768715 - 294015.99001645815) / 340300.74855768715 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400B) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 52.847118888752235 < 58.990789688704446. IsImprovementStdDev: Marked as improvement because 13.55617140836107 (TBase) = (62482.874836020186 -53949.587234728504) / Math.Sqrt((657561.1981764598 / (19)) + (1808159.167562185 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13657002216505576 = (62482.874836020186 - 53949.587234728504) / 62482.874836020186 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: BroadTree) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 494.04746657509145 < 565.7775435861356. IsImprovementStdDev: Marked as improvement because 17.57918468959799 (TBase) = (596014.160729882 -501283.2653050162) / Math.Sqrt((30344485.381865222 / (19)) + (137211003.32435173 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15894067904168221 = (596014.160729882 - 501283.2653050162) / 596014.160729882 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 40.61933333333334 < 46.77958336302083. IsImprovementStdDev: Marked as improvement because 18.701712513547843 (TBase) = (49318929.3020032 -41079049.991666675) / Math.Sqrt((232732439360.97202 / (19)) + (909373987409.0293 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1670733616271317 = (49318929.3020032 - 41079049.991666675) / 49318929.3020032 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 402.2871059833024 < 461.68433764171664. IsImprovementStdDev: Marked as improvement because 16.4428425924918 (TBase) = (485188.1295755864 -408403.0270300388) / Math.Sqrt((9511800.195135737 / (19)) + (106532952.9218763 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1582584112532073 = (485188.1295755864 - 408403.0270300388) / 485188.1295755864 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: BroadTree) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 437.1021863243518 < 497.57767205137196. IsImprovementStdDev: Marked as improvement because 22.780126533667612 (TBase) = (524168.25364006514 -444237.1038797026) / Math.Sqrt((30366201.74711769 / (19)) + (53567653.88744738 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1524913979533936 = (524168.25364006514 - 444237.1038797026) / 524168.25364006514 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfNumbers) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 85.55245473950511 < 99.18996276086129. IsImprovementStdDev: Marked as improvement because 17.120103914672825 (TBase) = (104425.23886787766 -85693.25340475817) / Math.Sqrt((2157332.2764320886 / (19)) + (5418117.280588604 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17938178227985507 = (104425.23886787766 - 85693.25340475817) / 104425.23886787766 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfNumbers) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 95.65665880805747 < 111.93453855935446. IsImprovementStdDev: Marked as improvement because 18.04174000867619 (TBase) = (117896.70160627463 -97536.2500510675) / Math.Sqrt((2215721.408035579 / (19)) + (5784694.314820372 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1726973806544857 = (117896.70160627463 - 97536.2500510675) / 117896.70160627463 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: DeepTree) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 251.339034127844 < 280.4935852377537. IsImprovementStdDev: Marked as improvement because 32.86393475024852 (TBase) = (296098.3682220703 -248213.8493886934) / Math.Sqrt((6523674.433683781 / (19)) + (8898271.485173453 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16171828004625832 = (296098.3682220703 - 248213.8493886934) / 296098.3682220703 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfStrings) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 82.92020939625849 < 94.28179888961377. IsImprovementStdDev: Marked as improvement because 24.02443135906564 (TBase) = (98995.57912693938 -82416.8316363944) / Math.Sqrt((1958531.0693773243 / (19)) + (1865639.8980872717 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1674695742653972 = (98995.57912693938 - 82416.8316363944) / 98995.57912693938 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400B) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 58.420210246995985 < 64.72761241427578. IsImprovementStdDev: Marked as improvement because 33.16708621903351 (TBase) = (68275.04183578503 -58600.52011204859) / Math.Sqrt((487926.0520221835 / (19)) + (297014.9494000581 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14169924270431908 = (68275.04183578503 - 58600.52011204859) / 68275.04183578503 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: HelloWorld) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.052488034156712 < 8.64039230656809. IsImprovementStdDev: Marked as improvement because 16.715821817908303 (TBase) = (9078.401558852049 -7960.9910532169) / Math.Sqrt((16952.142277261475 / (19)) + (17881.835478505054 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12308449878443624 = (9078.401558852049 - 7960.9910532169) / 9078.401558852049 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 38.02343747916667 < 43.02723183020833. IsImprovementStdDev: Marked as improvement because 35.15303786773695 (TBase) = (45551343.988782056 -37679287.479166664) / Math.Sqrt((407717442505.5465 / (19)) + (143444241587.4568 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17281721723850882 = (45551343.988782056 - 37679287.479166664) / 45551343.988782056 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 441.068344958515 < 503.95018772203747. IsImprovementStdDev: Marked as improvement because 41.42422927086604 (TBase) = (528792.6414050121 -442228.0206198534) / Math.Sqrt((24472221.892073624 / (19)) + (15394378.321662027 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1637023929742193 = (528792.6414050121 - 442228.0206198534) / 528792.6414050121 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: HelloWorld) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 8.649569576446282 < 9.534744176874566. IsImprovementStdDev: Marked as improvement because 23.167471921628444 (TBase) = (9983.155290251356 -8628.371839045929) / Math.Sqrt((35261.93772443604 / (19)) + (7818.824869656086 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13570693952125393 = (9983.155290251356 - 8628.371839045929) / 9983.155290251356 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Document.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfStrings) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 75.49999993533923 < 85.35739952316858. IsImprovementStdDev: Marked as improvement because 17.04402288963195 (TBase) = (89503.80639374981 -74425.35669272326) / Math.Sqrt((456975.15182575124 / (18)) + (3786326.659329561 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.16846713350594997 = (89503.80639374981 - 74425.35669272326) / 89503.80639374981 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.IO.Tests.Perf_File

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
40.49 μs 32.10 μs 0.79 0.00 True
30.29 μs 25.18 μs 0.83 0.00 True
59.07 μs 46.10 μs 0.78 0.00 True
24.76 μs 18.42 μs 0.74 0.00 True
13.01 μs 11.58 μs 0.89 0.00 True
90.20 μs 81.72 μs 0.91 0.00 True
39.30 μs 30.38 μs 0.77 0.00 True
18.31 μs 16.16 μs 0.88 0.00 True
50.54 μs 46.32 μs 0.92 0.00 True
15.99 μs 14.16 μs 0.89 0.00 True
37.30 μs 31.94 μs 0.86 0.00 True
57.87 μs 46.66 μs 0.81 0.00 True
24.33 μs 18.21 μs 0.75 0.00 True
17.37 μs 14.57 μs 0.84 0.00 True
4.66 μs 3.43 μs 0.74 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_File*'
### System.IO.Tests.Perf_File.CopyToOverwrite(size: 4096) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 32.099228923775094 < 38.04461982452945. IsImprovementStdDev: Marked as improvement because 29.151581070654416 (TBase) = (40097.08643725457 -31201.91136405164) / Math.Sqrt((354011.92467301217 / (19)) + (372376.58113077667 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.22184093318407144 = (40097.08643725457 - 31201.91136405164) / 40097.08643725457 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.ReadAllBytes(size: 16384) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 25.184449335045006 < 28.753644922254832. IsImprovementStdDev: Marked as improvement because 28.609951362461683 (TBase) = (30356.961959276006 -25219.00135083642) / Math.Sqrt((338175.7069576668 / (19)) + (72262.9213332443 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16925147566914572 = (30356.961959276006 - 25219.00135083642) / 30356.961959276006 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.CopyTo(size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 46.100803225401606 < 54.292220662581. IsImprovementStdDev: Marked as improvement because 25.244485785076634 (TBase) = (57624.124040279494 -45829.416971516686) / Math.Sqrt((694232.72294476 / (19)) + (908775.8262399306 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.20468349437326389 = (57624.124040279494 - 45829.416971516686) / 57624.124040279494 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.ReadAllBytes(size: 4096) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 18.416626279270556 < 23.733419706305728. IsImprovementStdDev: Marked as improvement because 12.450322446609986 (TBase) = (24773.027668312723 -19472.11072576831) / Math.Sqrt((136641.8913124615 / (19)) + (870422.63239258 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.2139793735961001 = (24773.027668312723 - 19472.11072576831) / 24773.027668312723 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.WriteAllBytes(size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.577451159124632 < 12.386477012407509. IsImprovementStdDev: Marked as improvement because 10.664824845193642 (TBase) = (13149.183470335309 -11405.778260792755) / Math.Sqrt((77806.48046674149 / (19)) + (113140.84497604445 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13258657569693919 = (13149.183470335309 - 11405.778260792755) / 13149.183470335309 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.ReadAllLines #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 81.72435976890758 < 85.9609755499002. IsImprovementStdDev: Marked as improvement because 14.2934234586372 (TBase) = (89398.85493868089 -80393.3460896981) / Math.Sqrt((763803.9207113495 / (18)) + (1772619.6624437913 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.10073405140546501 = (89398.85493868089 - 80393.3460896981) / 89398.85493868089 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.CopyToOverwrite(size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 30.38494363994439 < 37.76986988598527. IsImprovementStdDev: Marked as improvement because 23.37382134969908 (TBase) = (39724.078092354626 -30780.555659109592) / Math.Sqrt((401833.0247950406 / (19)) + (626282.5884219377 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.22514109484057032 = (39724.078092354626 - 30780.555659109592) / 39724.078092354626 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.AppendAllText(size: 100) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 16.164911106666665 < 17.58108642241758. IsImprovementStdDev: Marked as improvement because 14.093527208915484 (TBase) = (18673.348720172682 -15972.677844825395) / Math.Sqrt((94844.6852766055 / (19)) + (158641.40191888344 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14462702516928694 = (18673.348720172682 - 15972.677844825395) / 18673.348720172682 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.WriteAllText(size: 10000) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 46.320415991471215 < 47.74016819488818. IsImprovementStdDev: Marked as improvement because 8.239811143082221 (TBase) = (49792.29612480614 -45721.53803182432) / Math.Sqrt((2022404.4513779613 / (19)) + (688143.0040546631 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.08175477754185755 = (49792.29612480614 - 45721.53803182432) / 49792.29612480614 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.WriteAllText(size: 100) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.156675891249836 < 15.129735778784534. IsImprovementStdDev: Marked as improvement because 14.250069712241654 (TBase) = (16017.136291567038 -13623.662192885799) / Math.Sqrt((138435.45829250835 / (19)) + (104626.2419252767 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14943208667965163 = (16017.136291567038 - 13623.662192885799) / 16017.136291567038 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.AppendAllLines #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 31.94372218888888 < 34.514641836057685. IsImprovementStdDev: Marked as improvement because 19.227593340151095 (TBase) = (36443.690116506405 -32051.47234547619) / Math.Sqrt((282274.2107995732 / (19)) + (186625.60225425952 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1205206650860213 = (36443.690116506405 - 32051.47234547619) / 36443.690116506405 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.CopyTo(size: 4096) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 46.65610178841174 < 54.972722197897596. IsImprovementStdDev: Marked as improvement because 23.783155099681874 (TBase) = (57774.23114694789 -46279.349448978624) / Math.Sqrt((922477.0787162699 / (19)) + (925235.4441609529 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.19896208862965575 = (57774.23114694789 - 46279.349448978624) / 57774.23114694789 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.ReadAllBytes(size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 18.213411903376016 < 23.070779861315216. IsImprovementStdDev: Marked as improvement because 17.15649412520159 (TBase) = (24224.029739869224 -18743.295081306576) / Math.Sqrt((164656.2283363436 / (19)) + (466928.17006147135 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.22625197861040258 = (24224.029739869224 - 18743.295081306576) / 24224.029739869224 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.Delete #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.572244444444447 < 16.541176470588233. IsImprovementStdDev: Marked as improvement because 21.75437639690893 (TBase) = (17594.117647058818 -14467.715751633988) / Math.Sqrt((258809.68858131472 / (19)) + (35160.323219509664 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17769586165905088 = (17594.117647058818 - 14467.715751633988) / 17594.117647058818 is greater than 0.05. ``` #### JIT Disasms ### System.IO.Tests.Perf_File.Exists #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 3.4334647474589723 < 4.359312735249167. IsImprovementStdDev: Marked as improvement because 21.98754745158472 (TBase) = (4581.67232835668 -3561.2955570475374) / Math.Sqrt((5608.377080331961 / (19)) + (9292.173400483685 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.22270836894944943 = (4581.67232835668 - 3561.2955570475374) / 4581.67232835668 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Tests.Perf_Int32

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
217.23 ns 188.74 ns 0.87 0.00 True
187.55 ns 158.99 ns 0.85 0.00 True
89.32 ns 81.33 ns 0.91 0.00 True
230.09 ns 191.33 ns 0.83 0.00 True
225.18 ns 188.93 ns 0.84 0.00 True
31.05 ns 21.06 ns 0.68 0.00 True
254.40 ns 215.24 ns 0.85 0.00 True
268.14 ns 231.57 ns 0.86 0.00 True
58.00 ns 46.05 ns 0.79 0.00 True
204.38 ns 168.62 ns 0.83 0.00 True
229.76 ns 193.28 ns 0.84 0.00 True
233.44 ns 194.80 ns 0.83 0.00 True
243.99 ns 214.40 ns 0.88 0.00 True
225.77 ns 172.18 ns 0.76 0.00 True
203.77 ns 173.60 ns 0.85 0.00 True
246.19 ns 219.03 ns 0.89 0.00 True
260.15 ns 227.08 ns 0.87 0.00 True
246.33 ns 206.79 ns 0.84 0.00 True
250.47 ns 222.06 ns 0.89 0.00 True
228.30 ns 196.75 ns 0.86 0.00 True
73.16 ns 62.85 ns 0.86 0.00 True
134.86 ns 120.16 ns 0.89 0.00 True
248.11 ns 211.21 ns 0.85 0.00 True
225.19 ns 199.03 ns 0.88 0.00 True
263.26 ns 223.79 ns 0.85 0.00 True
271.35 ns 225.76 ns 0.83 0.00 True
278.91 ns 256.52 ns 0.92 0.00 True
117.16 ns 98.45 ns 0.84 0.00 True
185.74 ns 150.74 ns 0.81 0.00 True
228.41 ns 194.07 ns 0.85 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'
### System.Tests.Perf_Int32.ToString(value: -2147483648) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 188.74213069381872 < 205.00295959540162. IsImprovementStdDev: Marked as improvement because 14.004854206448442 (TBase) = (214.98989499385948 -193.06210380858903) / Math.Sqrt((14.37029406250941 / (18)) + (8.265771178113054 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.10199452018848025 = (214.98989499385948 - 193.06210380858903) / 214.98989499385948 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseSpan(value: "4") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 158.99425490615764 < 180.32574056216964. IsImprovementStdDev: Marked as improvement because 16.62804515078537 (TBase) = (192.23637505280286 -158.39469902945498) / Math.Sqrt((43.943374996672105 / (19)) + (9.14649006120754 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17604200044893872 = (192.23637505280286 - 158.39469902945498) / 192.23637505280286 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryFormat(value: 2147483647) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 81.32915618466724 < 85.14657465796182. IsImprovementStdDev: Marked as improvement because 17.28409529757367 (TBase) = (91.6535771936646 -81.61418177902397) / Math.Sqrt((4.403779333253773 / (19)) + (0.5280203401626528 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1095363184071619 = (91.6535771936646 - 81.61418177902397) / 91.6535771936646 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParse(value: "12345") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 191.32916609675698 < 213.93962027128657. IsImprovementStdDev: Marked as improvement because 12.8052301341654 (TBase) = (226.62885754861628 -191.28002809493464) / Math.Sqrt((16.87182852231772 / (19)) + (33.661828414603214 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15597673586691685 = (226.62885754861628 - 191.28002809493464) / 226.62885754861628 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.Parse(value: "4") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 188.93107933320667 < 213.6346134865737. IsImprovementStdDev: Marked as improvement because 11.531359057730535 (TBase) = (229.3041267535853 -192.70853181237516) / Math.Sqrt((17.48910613045569 / (19)) + (45.75539080136101 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1595941401461845 = (229.3041267535853 - 192.70853181237516) / 229.3041267535853 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToString(value: 4) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 21.06354659264414 < 29.223568503826026. IsImprovementStdDev: Marked as improvement because 30.967456398684043 (TBase) = (30.596877998534637 -21.438801477300263) / Math.Sqrt((1.0517249085457505 / (19)) + (0.16051819770388304 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.29931408432170686 = (30.596877998534637 - 21.438801477300263) / 30.596877998534637 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryFormat(value: -2147483648) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 215.24306476005057 < 245.3689013055545. IsImprovementStdDev: Marked as improvement because 11.704771929811717 (TBase) = (255.29558724445639 -220.5959532609228) / Math.Sqrt((16.606782977181652 / (19)) + (39.573216635631354 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13591944286254817 = (255.29558724445639 - 220.5959532609228) / 255.29558724445639 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.Parse(value: "-2147483648") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 231.57280141671131 < 255.63297399071146. IsImprovementStdDev: Marked as improvement because 18.101080405009384 (TBase) = (270.0277369996578 -232.28534586597888) / Math.Sqrt((21.838530324820177 / (19)) + (15.991030694855114 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1397722750745667 = (270.0277369996578 - 232.28534586597888) / 270.0277369996578 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryFormat(value: 4) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 46.05139831006554 < 55.297486046431715. IsImprovementStdDev: Marked as improvement because 7.077971707175083 (TBase) = (57.26667464692516 -47.770803890102464) / Math.Sqrt((15.586155483757324 / (19)) + (4.897954083484235 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1658184417965425 = (57.26667464692516 - 47.770803890102464) / 57.26667464692516 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParse(value: "4") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 168.61979231629098 < 196.5512009518043. IsImprovementStdDev: Marked as improvement because 18.005194559793793 (TBase) = (209.29835164499545 -172.75255938502386) / Math.Sqrt((24.195984483010697 / (19)) + (14.23177757172514 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1746109893973713 = (209.29835164499545 - 172.75255938502386) / 209.29835164499545 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseSpan(value: "2147483647") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 193.2769931115868 < 218.55167799613946. IsImprovementStdDev: Marked as improvement because 17.33928932246058 (TBase) = (229.9762050185443 -197.85170149548395) / Math.Sqrt((15.595438748975667 / (19)) + (13.05842596703666 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13968620588582184 = (229.9762050185443 - 197.85170149548395) / 229.9762050185443 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseSpan(value: "-2147483648") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 194.8010187818297 < 221.93021937792508. IsImprovementStdDev: Marked as improvement because 14.92097617191295 (TBase) = (232.93511115566312 -197.595598886314) / Math.Sqrt((24.166471741110374 / (19)) + (21.688062128399327 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1517139777426377 = (232.93511115566312 - 197.595598886314) / 232.93511115566312 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToStringHex(value: 12345) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 214.39643651114443 < 231.790015527012. IsImprovementStdDev: Marked as improvement because 14.17362207513163 (TBase) = (247.09661987793137 -211.987683186364) / Math.Sqrt((41.08559930065004 / (19)) + (19.867174034595646 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1420858638572701 = (247.09661987793137 - 211.987683186364) / 247.09661987793137 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseSpan(value: "12345") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 172.1784151215802 < 196.18555359282323. IsImprovementStdDev: Marked as improvement because 15.9910873843417 (TBase) = (208.10966464625918 -175.16604965400893) / Math.Sqrt((22.377055340255612 / (19)) + (15.33184550713783 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1582993036303584 = (208.10966464625918 - 175.16604965400893) / 208.10966464625918 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParseSpan(value: "12345") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 173.60350523092407 < 198.96291437654077. IsImprovementStdDev: Marked as improvement because 7.640046469463401 (TBase) = (204.62389926927827 -172.2774009899918) / Math.Sqrt((24.29243354775173 / (18)) + (82.87779933749508 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.15807781199946516 = (204.62389926927827 - 172.2774009899918) / 204.62389926927827 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParse(value: "-2147483648") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 219.03266085090297 < 233.83687546939674. IsImprovementStdDev: Marked as improvement because 14.636616795137327 (TBase) = (247.72379894922537 -212.25447107239916) / Math.Sqrt((8.469896528035608 / (19)) + (27.13368040848109 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14318094598612294 = (247.72379894922537 - 212.25447107239916) / 247.72379894922537 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToStringHex(value: 2147483647) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 227.07681456639102 < 246.49808387429505. IsImprovementStdDev: Marked as improvement because 9.3772006755248 (TBase) = (261.92216352338073 -230.3812334414967) / Math.Sqrt((26.071607215324985 / (19)) + (49.70727882637401 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12042100468931297 = (261.92216352338073 - 230.3812334414967) / 261.92216352338073 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.Parse(value: "12345") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 206.7862376799665 < 232.3795314473603. IsImprovementStdDev: Marked as improvement because 22.89807241507915 (TBase) = (243.62825942464934 -210.6619993021543) / Math.Sqrt((3.316160140382145 / (19)) + (9.490947165922266 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1353137776395395 = (243.62825942464934 - 210.6619993021543) / 243.62825942464934 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParse(value: "2147483647") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 222.06350198112352 < 234.45438183554037. IsImprovementStdDev: Marked as improvement because 13.700386597786315 (TBase) = (246.7401380112197 -214.38631663890345) / Math.Sqrt((17.404739072042705 / (19)) + (23.30383456284344 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13112508420030577 = (246.7401380112197 - 214.38631663890345) / 246.7401380112197 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToStringHex(value: 4) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 196.75134466336175 < 219.45651813563657. IsImprovementStdDev: Marked as improvement because 19.37466169187373 (TBase) = (233.38202767020775 -199.18359761879734) / Math.Sqrt((33.39792542472524 / (19)) + (6.789157905701676 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1465341200126011 = (233.38202767020775 - 199.18359761879734) / 233.38202767020775 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryFormat(value: 12345) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 62.84939812518485 < 69.72069261576941. IsImprovementStdDev: Marked as improvement because 15.964574681371506 (TBase) = (73.77975800782164 -63.79962600658497) / Math.Sqrt((2.5000528002930666 / (19)) + (1.2961062621732136 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13526924282102742 = (73.77975800782164 - 63.79962600658497) / 73.77975800782164 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToString(value: 2147483647) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 120.16266649101628 < 129.2114680077487. IsImprovementStdDev: Marked as improvement because 8.51194388613981 (TBase) = (137.20947807489216 -123.57975932809973) / Math.Sqrt((18.062505308199817 / (19)) + (8.066657871259732 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.09933511108724584 = (137.20947807489216 - 123.57975932809973) / 137.20947807489216 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseHex(value: "3039") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 211.20832345051605 < 235.531764857566. IsImprovementStdDev: Marked as improvement because 11.7172120119553 (TBase) = (252.05391740748354 -211.10491778631732) / Math.Sqrt((48.07216524380336 / (19)) + (48.416632086194944 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16246127035972993 = (252.05391740748354 - 211.10491778631732) / 252.05391740748354 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParseSpan(value: "2147483647") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 199.02855816287055 < 215.1798995219919. IsImprovementStdDev: Marked as improvement because 12.85207354172644 (TBase) = (227.67730237853297 -192.62460101498607) / Math.Sqrt((47.29567804390382 / (19)) + (24.7472293313239 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1539578209920495 = (227.67730237853297 - 192.62460101498607) / 227.67730237853297 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToStringHex(value: -2147483648) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 223.78938965536818 < 246.18197479968092. IsImprovementStdDev: Marked as improvement because 16.24611898496406 (TBase) = (262.6642216445231 -228.0676402873277) / Math.Sqrt((40.58354302091296 / (19)) + (11.994588858789347 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1317140992427081 = (262.6642216445231 - 228.0676402873277) / 262.6642216445231 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.Parse(value: "2147483647") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 225.75735924175368 < 253.5745952180509. IsImprovementStdDev: Marked as improvement because 12.328585076604917 (TBase) = (266.73795126447027 -229.1768163078303) / Math.Sqrt((21.50143419236022 / (19)) + (40.75272980773478 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14081661337871698 = (266.73795126447027 - 229.1768163078303) / 266.73795126447027 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ParseHex(value: "7FFFFFFF") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 256.5168772962817 < 265.2303874822546. IsImprovementStdDev: Marked as improvement because 7.77949811177271 (TBase) = (279.62874278513 -243.4048903314634) / Math.Sqrt((19.756780740703807 / (18)) + (102.9187036072843 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.12954266465197184 = (279.62874278513 - 243.4048903314634) / 279.62874278513 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.ToString(value: 12345) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 98.4508516397959 < 110.71078148974073. IsImprovementStdDev: Marked as improvement because 17.82336789457201 (TBase) = (115.02335022195557 -99.3138956289192) / Math.Sqrt((5.830364178787621 / (19)) + (2.3499928416864093 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13657622180820256 = (115.02335022195557 - 99.3138956289192) / 115.02335022195557 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParseSpan(value: "4") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 150.7432759998249 < 179.08104854924215. IsImprovementStdDev: Marked as improvement because 13.825583055169254 (TBase) = (188.87774002428924 -155.04466717276222) / Math.Sqrt((25.753059964963814 / (19)) + (23.165235749150238 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17912684071281332 = (188.87774002428924 - 155.04466717276222) / 188.87774002428924 is greater than 0.05. ``` #### JIT Disasms ### System.Tests.Perf_Int32.TryParseSpan(value: "-2147483648") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 194.07360675783127 < 217.6618257494941. IsImprovementStdDev: Marked as improvement because 26.600564808736852 (TBase) = (228.76421641947576 -193.03808659938062) / Math.Sqrt((13.917111302604777 / (19)) + (5.3566406095680374 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15617009678902563 = (228.76421641947576 - 193.03808659938062) / 228.76421641947576 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.IterateFor<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.11 μs 941.30 ns 0.85 0.00 True
159.36 μs 126.08 μs 0.79 0.00 True
37.72 μs 26.82 μs 0.71 0.00 True
1.76 μs 1.55 μs 0.88 0.00 True
160.33 μs 127.19 μs 0.79 0.00 True

graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor&lt;Int32&gt;*'
### System.Collections.IterateFor<Int32>.ImmutableArray(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 941.2972683091529 < 1.0497046579623932. IsImprovementStdDev: Marked as improvement because 102.440054083032 (TBase) = (1103.6792525482772 -943.9994072796477) / Math.Sqrt((14.789051469749642 / (19)) + (8.256866859257096 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1446795750667106 = (1103.6792525482772 - 943.9994072796477) / 1103.6792525482772 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.IterateFor<Int32>.ImmutableList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 126.08111825396824 < 151.34370149417217. IsImprovementStdDev: Marked as improvement because 28.329160247250325 (TBase) = (159995.98975308912 -122090.03575682579) / Math.Sqrt((3007776.4155814783 / (19)) + (8160426.114439326 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.23691815060340574 = (159995.98975308912 - 122090.03575682579) / 159995.98975308912 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.IterateFor<Int32>.IList(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 26.8205468156205 < 34.330443702506514. IsImprovementStdDev: Marked as improvement because 24.221753623031855 (TBase) = (36295.1112984375 -27299.75780226002) / Math.Sqrt((799891.7263505233 / (19)) + (479099.09121552354 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.2478392591832258 = (36295.1112984375 - 27299.75780226002) / 36295.1112984375 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.IterateFor<Int32>.List(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.5511982185174056 < 1.671283181803175. IsImprovementStdDev: Marked as improvement because 173.16958191338418 (TBase) = (1757.8649663473202 -1550.6628847857169) / Math.Sqrt((6.655853988568983 / (19)) + (5.406843869877837 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11787144378453027 = (1757.8649663473202 - 1550.6628847857169) / 1757.8649663473202 is greater than 0.05. ``` #### JIT Disasms ### System.Collections.IterateFor<Int32>.ImmutableSortedSet(Size: 512) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 127.19351424731181 < 151.9005921053434. IsImprovementStdDev: Marked as improvement because 22.877625729245608 (TBase) = (160565.94617897004 -122685.28065013152) / Math.Sqrt((2985002.405666828 / (19)) + (12922763.697307235 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.23591967307075168 = (160565.94617897004 - 122685.28065013152) / 160565.94617897004 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
8.43 μs 6.79 μs 0.81 0.00 True
5.22 μs 4.55 μs 0.87 0.00 True
5.17 μs 4.72 μs 0.91 0.00 True
33.12 μs 26.54 μs 0.80 0.00 True
130.78 μs 114.80 μs 0.88 0.00 True
104.98 μs 89.49 μs 0.85 0.00 True
2.18 ms 1.78 ms 0.82 0.00 True
3.53 μs 2.89 μs 0.82 0.00 True
12.89 μs 10.69 μs 0.83 0.00 True
2.10 ms 1.82 ms 0.87 0.00 True
2.17 ms 1.79 ms 0.82 0.00 True
2.47 ms 1.86 ms 0.75 0.00 True
12.97 μs 11.32 μs 0.87 0.00 True
2.28 ms 1.88 ms 0.82 0.00 True
126.99 μs 110.40 μs 0.87 0.00 True
32.05 μs 26.04 μs 0.81 0.00 True
101.83 μs 87.74 μs 0.86 0.00 True
5.96 μs 4.90 μs 0.82 0.00 True
84.89 μs 72.49 μs 0.85 0.00 True
5.80 μs 4.67 μs 0.80 0.00 True
12.61 μs 10.22 μs 0.81 0.00 True
11.44 μs 9.01 μs 0.79 0.00 True
4.29 μs 3.76 μs 0.88 0.00 True
1.05 ms 880.14 μs 0.84 0.00 True
7.50 μs 6.33 μs 0.84 0.00 True
1.10 ms 827.77 μs 0.75 0.00 True
3.52 μs 3.12 μs 0.89 0.00 True
13.29 μs 10.48 μs 0.79 0.00 True
27.17 μs 20.59 μs 0.76 0.00 True
7.68 μs 6.40 μs 0.83 0.00 True
127.42 μs 110.88 μs 0.87 0.00 True
26.28 μs 23.53 μs 0.90 0.00 True
11.84 μs 9.51 μs 0.80 0.00 True
5.91 μs 4.92 μs 0.83 0.00 True
30.90 μs 23.76 μs 0.77 0.00 True
5.28 μs 4.67 μs 0.88 0.00 True
1.09 ms 885.56 μs 0.81 0.00 True
8.68 μs 7.13 μs 0.82 0.00 True
80.90 μs 71.69 μs 0.89 0.00 True
31.70 μs 24.20 μs 0.76 0.00 True
15.21 μs 14.29 μs 0.94 0.00 True
100.68 μs 87.49 μs 0.87 0.00 True
12.86 μs 10.04 μs 0.78 0.00 True
128.12 μs 113.49 μs 0.89 0.00 True
2.37 ms 1.95 ms 0.82 0.00 True
3.39 μs 2.91 μs 0.86 0.00 True
11.49 μs 9.53 μs 0.83 0.00 True
204.97 μs 180.87 μs 0.88 0.00 True
21.90 μs 17.24 μs 0.79 0.00 True
8.66 μs 7.07 μs 0.82 0.00 True
5.75 μs 5.09 μs 0.89 0.00 True
7.43 μs 6.27 μs 0.84 0.00 True
81.79 μs 72.85 μs 0.89 0.00 True
13.06 μs 10.22 μs 0.78 0.00 True
200.24 μs 177.74 μs 0.89 0.00 True
23.13 μs 17.71 μs 0.77 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'
### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 6.787818847826086 < 7.956645130022783. IsImprovementStdDev: Marked as improvement because 9.598838807411022 (TBase) = (8468.66260358939 -7164.897942855981) / Math.Sqrt((38976.74466769083 / (19)) + (81985.45178833793 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15395165940142858 = (8468.66260358939 - 7164.897942855981) / 8468.66260358939 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchWord(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.549873833097156 < 4.927538249178386. IsImprovementStdDev: Marked as improvement because 19.954236897390203 (TBase) = (5218.519876762683 -4527.791673095056) / Math.Sqrt((5813.4688742399885 / (19)) + (4461.344153936213 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1323609414123995 = (5218.519876762683 - 4527.791673095056) / 5218.519876762683 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.715250603389614 < 4.985204236215667. IsImprovementStdDev: Marked as improvement because 15.896251464076597 (TBase) = (5417.063594775942 -4557.751150705977) / Math.Sqrt((21713.49560030025 / (19)) + (8897.016985785693 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15863067306403061 = (5417.063594775942 - 4557.751150705977) / 5417.063594775942 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 26.538847697128258 < 32.72997030389486. IsImprovementStdDev: Marked as improvement because 38.58404423242251 (TBase) = (34546.144832839316 -26956.986810043752) / Math.Sqrt((433905.79171896 / (19)) + (79252.22491647709 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.21968176360973757 = (34546.144832839316 - 26956.986810043752) / 34546.144832839316 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 114.80104986213233 < 122.9928021186578. IsImprovementStdDev: Marked as improvement because 28.52704955363826 (TBase) = (128961.30639627196 -115373.12096555051) / Math.Sqrt((1396110.2023109086 / (18)) + (746625.5757645573 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.10536637546899309 = (128961.30639627196 - 115373.12096555051) / 128961.30639627196 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 89.4875306855501 < 100.29095263954288. IsImprovementStdDev: Marked as improvement because 20.78973287476882 (TBase) = (105078.55031845524 -90841.344572056) / Math.Sqrt((1967195.061002288 / (19)) + (1827202.9527326971 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13549107504101832 = (105078.55031845524 - 90841.344572056) / 105078.55031845524 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.778480548611111 < 2.0339002372470234. IsImprovementStdDev: Marked as improvement because 18.76101701281072 (TBase) = (2119602.998220316 -1767249.2572619047) / Math.Sqrt((909728385.0218496 / (19)) + (1524258435.7690408 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1662357249231382 = (2119602.998220316 - 1767249.2572619047) / 2119602.998220316 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 2.8903510372656456 < 3.2505656992287566. IsImprovementStdDev: Marked as improvement because 16.139173273825726 (TBase) = (3453.052047810209 -2917.3438902810676) / Math.Sqrt((5273.1313011838865 / (19)) + (4121.222022301729 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15514048155424318 = (3453.052047810209 - 2917.3438902810676) / 3453.052047810209 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.691483529908878 < 11.980387583752242. IsImprovementStdDev: Marked as improvement because 21.04269259210929 (TBase) = (12856.829221360935 -10700.539149583445) / Math.Sqrt((80987.80236473828 / (19)) + (31190.13390576728 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1677155412622989 = (12856.829221360935 - 10700.539149583445) / 12856.829221360935 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.8190793645833336 < 2.0115405166454083. IsImprovementStdDev: Marked as improvement because 18.164097444044238 (TBase) = (2133035.8212452577 -1813492.6759340658) / Math.Sqrt((1034315011.5194067 / (19)) + (1275207481.776006 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14980674123167978 = (2133035.8212452577 - 1813492.6759340658) / 2133035.8212452577 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.7928625992063494 < 2.0211695319921876. IsImprovementStdDev: Marked as improvement because 27.481189026960624 (TBase) = (2120124.829746411 -1762905.8907804233) / Math.Sqrt((728578042.2373989 / (19)) + (653096194.5519634 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1684895785163343 = (2120124.829746411 - 1762905.8907804233) / 2120124.829746411 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.8556086519083965 < 2.156530898680011. IsImprovementStdDev: Marked as improvement because 16.137870890884162 (TBase) = (2303219.7732192916 -1892777.9497980643) / Math.Sqrt((3229125358.0341682 / (19)) + (2384533497.801128 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.178203499376674 = (2303219.7732192916 - 1892777.9497980643) / 2303219.7732192916 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.319148977330293 < 12.000355696290125. IsImprovementStdDev: Marked as improvement because 11.001694165247539 (TBase) = (12723.92514725936 -10774.039545828025) / Math.Sqrt((75109.78768873484 / (19)) + (137295.54666025465 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15324560454926334 = (12723.92514725936 - 10774.039545828025) / 12723.92514725936 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.882180510520487 < 2.1718273944051254. IsImprovementStdDev: Marked as improvement because 24.820565276198938 (TBase) = (2298196.4326705327 -1874858.1965956974) / Math.Sqrt((1664819991.240561 / (19)) + (1016416049.0765467 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18420454842622438 = (2298196.4326705327 - 1874858.1965956974) / 2298196.4326705327 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 110.39600422804148 < 120.44408430778613. IsImprovementStdDev: Marked as improvement because 24.298852057549166 (TBase) = (125559.78916479289 -111183.97764344043) / Math.Sqrt((1178433.2141370296 / (19)) + (1439987.4719148546 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11449375327068048 = (125559.78916479289 - 111183.97764344043) / 125559.78916479289 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 26.041125000000008 < 30.156428000623205. IsImprovementStdDev: Marked as improvement because 17.49264053267196 (TBase) = (31667.992108653205 -25845.981186940982) / Math.Sqrt((209863.45647407448 / (19)) + (498639.52273478237 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18384528143548992 = (31667.992108653205 - 25845.981186940982) / 31667.992108653205 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWords(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 87.74339472765364 < 97.71693750905432. IsImprovementStdDev: Marked as improvement because 19.586607984968037 (TBase) = (103710.26576549107 -88927.40763885753) / Math.Sqrt((3085434.948245514 / (19)) + (2036229.5155281392 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14253996957312243 = (103710.26576549107 - 88927.40763885753) / 103710.26576549107 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.90262951183432 < 5.645376504614922. IsImprovementStdDev: Marked as improvement because 12.230702777930365 (TBase) = (5895.774580925906 -4950.880252945548) / Math.Sqrt((17677.65869986736 / (19)) + (25190.378805218435 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16026635940887116 = (5895.774580925906 - 4950.880252945548) / 5895.774580925906 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 72.48682338408119 < 80.12236024467761. IsImprovementStdDev: Marked as improvement because 17.68546393513518 (TBase) = (84084.63856459175 -72718.23552866174) / Math.Sqrt((1232993.4563651897 / (19)) + (1740828.2671471173 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13517811612163402 = (84084.63856459175 - 72718.23552866174) / 84084.63856459175 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.668196212092542 < 5.144328979484158. IsImprovementStdDev: Marked as improvement because 14.776619163761852 (TBase) = (5394.729463836687 -4633.37339549254) / Math.Sqrt((25840.82508430469 / (19)) + (6473.589014221934 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14112961056673198 = (5394.729463836687 - 4633.37339549254) / 5394.729463836687 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.222352661667996 < 12.103318589262917. IsImprovementStdDev: Marked as improvement because 9.195846742407655 (TBase) = (12742.864627417015 -10622.730945358406) / Math.Sqrt((35741.56701453514 / (19)) + (256368.66312112228 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16637810602625552 = (12742.864627417015 - 10622.730945358406) / 12742.864627417015 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 9.013907704798786 < 10.962782522493276. IsImprovementStdDev: Marked as improvement because 24.79862849471841 (TBase) = (11504.976785220344 -9109.51296465097) / Math.Sqrt((45763.032211168356 / (19)) + (34611.63672400734 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.20821109553620848 = (11504.976785220344 - 9109.51296465097) / 11504.976785220344 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchWord(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 3.762318199225473 < 4.07403255242445. IsImprovementStdDev: Marked as improvement because 11.65002638899785 (TBase) = (4307.048192372094 -3705.0058642797076) / Math.Sqrt((6937.335835360716 / (19)) + (11527.120585849287 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.13978072712504594 = (4307.048192372094 - 3705.0058642797076) / 4307.048192372094 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWords(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 880.1355394607845 < 1.0222795056790677. IsImprovementStdDev: Marked as improvement because 25.20505322226799 (TBase) = (1070731.1271855694 -854702.0459182423) / Math.Sqrt((368463955.3637354 / (18)) + (264947442.9735375 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.20175847678507516 = (1070731.1271855694 - 854702.0459182423) / 1070731.1271855694 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 6.326275793045878 < 7.129361943762969. IsImprovementStdDev: Marked as improvement because 24.85291971157163 (TBase) = (7465.455709061347 -6173.696714795571) / Math.Sqrt((11554.744891515025 / (19)) + (10466.876651286904 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17303149929586717 = (7465.455709061347 - 6173.696714795571) / 7465.455709061347 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 827.767861359127 < 1.0422920965871108. IsImprovementStdDev: Marked as improvement because 35.541471767696066 (TBase) = (1093966.6869582161 -846930.3875027446) / Math.Sqrt((356147465.5059456 / (19)) + (147834598.68848833 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.22581702203598003 = (1093966.6869582161 - 846930.3875027446) / 1093966.6869582161 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 3.1249356067110257 < 3.3026601666247197. IsImprovementStdDev: Marked as improvement because 8.936120184052946 (TBase) = (3443.6838285383587 -2943.1770883158415) / Math.Sqrt((4508.881457794613 / (19)) + (14498.71734070654 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14534050311899652 = (3443.6838285383587 - 2943.1770883158415) / 3443.6838285383587 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.481561815050622 < 12.242035077654048. IsImprovementStdDev: Marked as improvement because 30.39272956136904 (TBase) = (12804.894105894648 -10611.779497915273) / Math.Sqrt((44206.89482164739 / (19)) + (14401.346831610852 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17127159270843081 = (12804.894105894648 - 10611.779497915273) / 12804.894105894648 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 20.591139945908914 < 24.28558153761222. IsImprovementStdDev: Marked as improvement because 12.071603370155904 (TBase) = (25553.909509868296 -21022.154281316507) / Math.Sqrt((357060.978811936 / (19)) + (610685.8086174832 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17734097503952323 = (25553.909509868296 - 21022.154281316507) / 25553.909509868296 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 6.401229655882554 < 7.061147879226348. IsImprovementStdDev: Marked as improvement because 13.259322493767028 (TBase) = (7452.357651951187 -6366.244025114689) / Math.Sqrt((23991.59241148069 / (19)) + (27235.290375955716 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14574094233817805 = (7452.357651951187 - 6366.244025114689) / 7452.357651951187 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 110.88052874313188 < 120.35619315186555. IsImprovementStdDev: Marked as improvement because 42.782602404058004 (TBase) = (125961.67180256415 -111753.00629758163) / Math.Sqrt((1130875.2801609195 / (19)) + (253897.01495289945 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11280149986619406 = (125961.67180256415 - 111753.00629758163) / 125961.67180256415 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 23.525871523329066 < 24.815782889043003. IsImprovementStdDev: Marked as improvement because 12.410271636705426 (TBase) = (26188.32828400451 -23573.229906778422) / Math.Sqrt((120295.9136127027 / (19)) + (190358.78086082998 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.09985740016950055 = (26188.32828400451 - 23573.229906778422) / 26188.32828400451 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 9.513987863935883 < 10.814723390310693. IsImprovementStdDev: Marked as improvement because 25.326495040885973 (TBase) = (11407.298445664948 -9264.701051675152) / Math.Sqrt((37383.145642056894 / (19)) + (25947.325520237 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18782689031898128 = (11407.298445664948 - 9264.701051675152) / 11407.298445664948 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.918323562262358 < 5.584627039391931. IsImprovementStdDev: Marked as improvement because 19.102574765079098 (TBase) = (5839.118512363087 -4958.766249305669) / Math.Sqrt((12491.259013163446 / (19)) + (7332.206485421499 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15076800739588692 = (5839.118512363087 - 4958.766249305669) / 5839.118512363087 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchWord(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 23.75931660839161 < 29.040467098033204. IsImprovementStdDev: Marked as improvement because 20.858306039068964 (TBase) = (30409.86656387974 -24257.04561442186) / Math.Sqrt((345863.1382147427 / (19)) + (344054.73722190375 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.20232975822281588 = (30409.86656387974 - 24257.04561442186) / 30409.86656387974 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.668415792103301 < 5.07810816518748. IsImprovementStdDev: Marked as improvement because 19.477111248345008 (TBase) = (5429.023277572495 -4613.7441154999115) / Math.Sqrt((11876.460917052846 / (19)) + (5635.210459616144 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15017050404637858 = (5429.023277572495 - 4613.7441154999115) / 5429.023277572495 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 885.564862657563 < 1.026732190082908. IsImprovementStdDev: Marked as improvement because 18.06654900206926 (TBase) = (1076571.3955134745 -875051.0292987548) / Math.Sqrt((226802292.851103 / (19)) + (562411295.2491866 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18718718243354765 = (1076571.3955134745 - 875051.0292987548) / 1076571.3955134745 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.128106770560045 < 8.16239749324534. IsImprovementStdDev: Marked as improvement because 16.21585644923617 (TBase) = (8562.523735154133 -7023.7510203877555) / Math.Sqrt((30091.596148104298 / (19)) + (37104.65093109685 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1797101838618936 = (8562.523735154133 - 7023.7510203877555) / 8562.523735154133 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 71.69327733112476 < 75.26498190502762. IsImprovementStdDev: Marked as improvement because 14.863924238056143 (TBase) = (80077.85603425904 -69997.24273882923) / Math.Sqrt((1059375.7275248773 / (19)) + (2020947.4307459174 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12588515470640352 = (80077.85603425904 - 69997.24273882923) / 80077.85603425904 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 24.19532180281019 < 30.48265577870494. IsImprovementStdDev: Marked as improvement because 15.021814758653441 (TBase) = (32150.95311879069 -25352.151123296666) / Math.Sqrt((517486.44072844816 / (19)) + (888031.656106364 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.21146502159279534 = (32150.95311879069 - 25352.151123296666) / 32150.95311879069 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 14.291469041974006 < 14.544342928746966. IsImprovementStdDev: Marked as improvement because 8.075275498066167 (TBase) = (15279.786824905188 -14154.141394975635) / Math.Sqrt((30259.30028935524 / (19)) + (89190.5447848288 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.07366892240242609 = (15279.786824905188 - 14154.141394975635) / 15279.786824905188 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 87.48952524709927 < 97.22419752231531. IsImprovementStdDev: Marked as improvement because 27.09636824741927 (TBase) = (102424.66354270332 -87156.43070030832) / Math.Sqrt((3490399.570206107 / (19)) + (669016.3732063398 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14906793260813886 = (102424.66354270332 - 87156.43070030832) / 102424.66354270332 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.042584293839878 < 12.144207560793875. IsImprovementStdDev: Marked as improvement because 13.967178115296177 (TBase) = (12753.798078189915 -10512.724558286614) / Math.Sqrt((81781.18825627476 / (19)) + (107204.21829419109 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1757181277423333 = (12753.798078189915 - 10512.724558286614) / 12753.798078189915 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 113.48765042270531 < 122.13409132620389. IsImprovementStdDev: Marked as improvement because 24.315243717352047 (TBase) = (129048.96551505174 -113589.94417219886) / Math.Sqrt((832154.2412753126 / (19)) + (1802060.580672368 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11979190442289755 = (129048.96551505174 - 113589.94417219886) / 129048.96551505174 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.9487013328 < 2.194595937489379. IsImprovementStdDev: Marked as improvement because 12.036940755973571 (TBase) = (2273232.3352143555 -1935863.256650369) / Math.Sqrt((2631229942.4378424 / (19)) + (3235361503.641866 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14840941391596657 = (2273232.3352143555 - 1935863.256650369) / 2273232.3352143555 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 2.906475920106316 < 3.2512299647781475. IsImprovementStdDev: Marked as improvement because 18.122696236573347 (TBase) = (3398.0455507838838 -2940.702345790755) / Math.Sqrt((2735.567375904465 / (19)) + (2464.3762139036503 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1345900748409997 = (3398.0455507838838 - 2940.702345790755) / 3398.0455507838838 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 9.532205931342677 < 10.963511830715008. IsImprovementStdDev: Marked as improvement because 24.809835710657612 (TBase) = (11462.170427825671 -9324.356070384514) / Math.Sqrt((19890.08139733908 / (18)) + (31599.613580453926 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.1865104319380367 = (11462.170427825671 - 9324.356070384514) / 11462.170427825671 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 180.86559921239837 < 195.7396807517027. IsImprovementStdDev: Marked as improvement because 28.352360791884717 (TBase) = (205944.7676545339 -181480.51818330158) / Math.Sqrt((3330791.17256591 / (19)) + (2846152.9065433065 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11879034242943409 = (205944.7676545339 - 181480.51818330158) / 205944.7676545339 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 17.23591654005525 < 21.49372761533746. IsImprovementStdDev: Marked as improvement because 21.741142717066648 (TBase) = (22872.939357057126 -17528.216853785118) / Math.Sqrt((225744.4793221184 / (19)) + (242766.514592882 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.2336701208287412 = (22872.939357057126 - 17528.216853785118) / 22872.939357057126 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 7.073851033120632 < 8.229132399721657. IsImprovementStdDev: Marked as improvement because 18.031021004524852 (TBase) = (8519.216222360023 -7058.718975499552) / Math.Sqrt((23710.164484869052 / (19)) + (26564.788777672657 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17143563547866836 = (8519.216222360023 - 7058.718975499552) / 8519.216222360023 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 5.093047535354356 < 5.515937254470376. IsImprovementStdDev: Marked as improvement because 13.477700325167387 (TBase) = (5825.812034497908 -4983.347115622526) / Math.Sqrt((12340.233092531122 / (18)) + (16108.446147282513 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.14460901139389215 = (5825.812034497908 - 4983.347115622526) / 5825.812034497908 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 6.271738827687851 < 7.021423622100878. IsImprovementStdDev: Marked as improvement because 22.803607919156352 (TBase) = (7391.3473342393745 -6294.363001194237) / Math.Sqrt((16211.998153137121 / (19)) + (7304.493679568307 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14841466426067035 = (7391.3473342393745 - 6294.363001194237) / 7391.3473342393745 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWords(Options: Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 72.8539150412088 < 77.49023685993505. IsImprovementStdDev: Marked as improvement because 17.399839920329473 (TBase) = (82409.25847119295 -71956.83201306252) / Math.Sqrt((2076417.3144086772 / (19)) + (1257895.1259407322 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1268355843995877 = (82409.25847119295 - 71956.83201306252) / 82409.25847119295 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 10.224447538784213 < 12.126575384391488. IsImprovementStdDev: Marked as improvement because 12.978442203736616 (TBase) = (12994.158549243375 -10596.281646887355) / Math.Sqrt((148246.48268251185 / (19)) + (131666.19726834734 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18453498880045938 = (12994.158549243375 - 10596.281646887355) / 12994.158549243375 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: IgnoreCase, Compiled) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 177.73951027097905 < 192.30941153567986. IsImprovementStdDev: Marked as improvement because 28.692906968468435 (TBase) = (202803.05710914131 -177184.591651448) / Math.Sqrt((2395498.21440309 / (19)) + (3355512.425606188 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12632188993041849 = (202803.05710914131 - 177184.591651448) / 202803.05710914131 is greater than 0.05. ``` #### JIT Disasms ### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: None) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 17.71382705479452 < 21.655825413110446. IsImprovementStdDev: Marked as improvement because 11.688035103261898 (TBase) = (22442.009136211796 -18250.439840833784) / Math.Sqrt((226024.1418963376 / (19)) + (583563.3706147682 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1867733530423804 = (22442.009136211796 - 18250.439840833784) / 22442.009136211796 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
299.17 μs 256.22 μs 0.86 0.00 True
254.89 μs 217.34 μs 0.85 0.00 True
229.24 μs 202.05 μs 0.88 0.00 True
232.41 μs 208.64 μs 0.90 0.00 True
287.36 μs 257.11 μs 0.89 0.00 True
306.23 μs 261.61 μs 0.85 0.00 True
247.75 μs 228.08 μs 0.92 0.00 True
294.31 μs 251.97 μs 0.86 0.00 True

graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableDictionary&lt;String, String&gt;&gt;*'
### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 256.2188397988506 < 283.78834035667785. IsImprovementStdDev: Marked as improvement because 13.302821944269933 (TBase) = (296819.94098481967 -257570.1027352898) / Math.Sqrt((13653726.302783098 / (19)) + (23960315.71955052 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.1322345059408836 = (296819.94098481967 - 257570.1027352898) / 296819.94098481967 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 217.34191130514702 < 236.0999709142962. IsImprovementStdDev: Marked as improvement because 10.790488002433067 (TBase) = (251276.47162961354 -221104.95952565366) / Math.Sqrt((15624758.118018484 / (19)) + (20987813.978365898 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.12007296945984378 = (251276.47162961354 - 221104.95952565366) / 251276.47162961354 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToWriter(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 202.0486110443376 < 220.32162729818984. IsImprovementStdDev: Marked as improvement because 21.38071830438268 (TBase) = (233241.29833384004 -199692.58687683698) / Math.Sqrt((12116652.88955198 / (19)) + (5473168.386796023 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.14383692637906914 = (233241.29833384004 - 199692.58687683698) / 233241.29833384004 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 208.6409608333333 < 223.40410530785095. IsImprovementStdDev: Marked as improvement because 15.330637780571687 (TBase) = (235006.80533590386 -210499.9802613868) / Math.Sqrt((7346855.89304695 / (19)) + (6506077.732591778 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.10428134214874564 = (235006.80533590386 - 210499.9802613868) / 235006.80533590386 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToWriter(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 257.110655501261 < 275.19547189986156. IsImprovementStdDev: Marked as improvement because 11.101891910644648 (TBase) = (289730.804568335 -250962.19178253945) / Math.Sqrt((9831804.187149921 / (18)) + (34945079.54611021 / (3))) is greater than 2.0930240543939185 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (3) - 2, .975) and 0.13380908130758223 = (289730.804568335 - 250962.19178253945) / 289730.804568335 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 261.606784519828 < 288.2995350984969. IsImprovementStdDev: Marked as improvement because 23.356149195305527 (TBase) = (302920.7178593757 -263562.88758039265) / Math.Sqrt((11794690.255613467 / (19)) + (6656532.429789934 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.12992782585856033 = (302920.7178593757 - 263562.88758039265) / 302920.7178593757 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 228.07623133116883 < 234.10120606577078. IsImprovementStdDev: Marked as improvement because 5.42299990562953 (TBase) = (244505.55737316367 -219666.22122939173) / Math.Sqrt((20178734.952004883 / (19)) + (59753201.62309177 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.10159006777037063 = (244505.55737316367 - 219666.22122939173) / 244505.55737316367 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 251.97119230769235 < 279.3565346424359. IsImprovementStdDev: Marked as improvement because 14.235556277944116 (TBase) = (290768.1881233701 -248560.52759759536) / Math.Sqrt((30399609.515655775 / (19)) + (21572782.104672424 / (3))) is greater than 2.08596344725343 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (3) - 2, .975) and 0.14515914137026042 = (290768.1881233701 - 248560.52759759536) / 290768.1881233701 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_FromStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
32.34 μs 27.82 μs 0.86 0.00 True
112.00 μs 100.21 μs 0.89 0.00 True
93.85 μs 81.70 μs 0.87 0.00 True

graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;Location&gt;*'
### MicroBenchmarks.Serializers.Xml_FromStream<Location>.DataContractSerializer_BinaryXml_ #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 27.823009831012012 < 30.71014455747462. IsImprovementStdDev: Marked as improvement because 24.381367527957718 (TBase) = (32246.992169196565 -27524.506209365714) / Math.Sqrt((104835.80373822479 / (19)) + (159995.38892361356 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.14644733174035163 = (32246.992169196565 - 27524.506209365714) / 32246.992169196565 is greater than 0.05. ``` #### JIT Disasms ### MicroBenchmarks.Serializers.Xml_FromStream<Location>.XmlSerializer_ #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 100.21471779953917 < 106.99752671808831. IsImprovementStdDev: Marked as improvement because 47.907517520167396 (TBase) = (112585.90707256742 -100119.46659980656) / Math.Sqrt((927324.3867087938 / (19)) + (94536.58985698158 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11072825007063805 = (112585.90707256742 - 100119.46659980656) / 112585.90707256742 is greater than 0.05. ``` #### JIT Disasms ### MicroBenchmarks.Serializers.Xml_FromStream<Location>.DataContractSerializer_ #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 81.69602715080971 < 89.2648992897793. IsImprovementStdDev: Marked as improvement because 16.737666883134178 (TBase) = (94372.58237956165 -83481.57011342798) / Math.Sqrt((879621.4573192497 / (19)) + (1885500.197481435 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11540441081002294 = (94372.58237956165 - 83481.57011342798) / 94372.58237956165 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.31 μs 11.08 μs 0.90 0.00 True
7.36 μs 6.53 μs 0.89 0.00 True
4.85 μs 4.18 μs 0.86 0.00 True
5.29 μs 4.19 μs 0.79 0.00 True
3.91 μs 3.50 μs 0.90 0.00 True
10.85 μs 9.80 μs 0.90 0.00 True
3.20 μs 2.46 μs 0.77 0.00 True
6.07 μs 5.40 μs 0.89 0.00 True

graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;LoginViewModel&gt;*'
### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeObjectProperty(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 11.076439278607642 < 11.754276090807583. IsImprovementStdDev: Marked as improvement because 13.45037740698139 (TBase) = (12460.533729832703 -11229.457538220886) / Math.Sqrt((15005.920397233076 / (19)) + (37937.27030306333 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.09879803051007396 = (12460.533729832703 - 11229.457538220886) / 12460.533729832703 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToString(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 6.5289290202884676 < 6.869969790909996. IsImprovementStdDev: Marked as improvement because 13.202069969147276 (TBase) = (7321.044817623554 -6503.905661085667) / Math.Sqrt((24424.593320339787 / (19)) + (12727.291597157046 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11161510097176737 = (7321.044817623554 - 6503.905661085667) / 7321.044817623554 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToString(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.184650349939648 < 4.721585201977321. IsImprovementStdDev: Marked as improvement because 11.868647589546692 (TBase) = (4945.651091853025 -4283.471814783073) / Math.Sqrt((6486.657109804379 / (19)) + (13856.894786118944 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1338912237785558 = (4945.651091853025 - 4283.471814783073) / 4945.651091853025 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToWriter(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 4.1913311683664345 < 4.8322830721054455. IsImprovementStdDev: Marked as improvement because 30.035671784692205 (TBase) = (5018.198232271623 -4195.304339587252) / Math.Sqrt((13604.571386827807 / (19)) + (172.8878164202901 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.16398194224221907 = (5018.198232271623 - 4195.304339587252) / 5018.198232271623 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToUtf8Bytes(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 3.502588913690476 < 3.793566530063776. IsImprovementStdDev: Marked as improvement because 11.395583819899374 (TBase) = (3992.594649750374 -3485.9493549044732) / Math.Sqrt((5807.6588126773095 / (19)) + (8355.034588338895 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12689625150842135 = (3992.594649750374 - 3485.9493549044732) / 3992.594649750374 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeObjectProperty(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 9.796979998670405 < 10.687024895654279. IsImprovementStdDev: Marked as improvement because 18.853695359753775 (TBase) = (11249.910508040819 -9959.534287496117) / Math.Sqrt((38537.134776235216 / (18)) + (12716.47232636981 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.11470102092122526 = (11249.910508040819 - 9959.534287496117) / 11249.910508040819 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToWriter(Mode: SourceGen) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 2.464239843929144 < 2.866557949101492. IsImprovementStdDev: Marked as improvement because 21.425713205515706 (TBase) = (3057.719308061935 -2498.3349794186734) / Math.Sqrt((5950.359681069436 / (19)) + (1842.276227901471 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1829416870176401 = (3057.719308061935 - 2498.3349794186734) / 3057.719308061935 is greater than 0.05. ``` #### JIT Disasms ### System.Text.Json.Serialization.Tests.WriteJson<LoginViewModel>.SerializeToUtf8Bytes(Mode: Reflection) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 5.3974189340552305 < 5.800266665017646. IsImprovementStdDev: Marked as improvement because 8.302702314392135 (TBase) = (6077.633060493223 -5408.267066392424) / Math.Sqrt((12518.840803334977 / (19)) + (29203.69737619159 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.11013596698555499 = (6077.633060493223 - 5408.267066392424) / 6077.633060493223 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
performanceautofiler[bot] commented 1 year ago

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline b2e18f840333d77206f0e88ebefba84501b6b808
Compare 64243bbf5e9ee53c0c4c5678f2cd8c7f1c9b4f6f
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Memory.ReadOnlySpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
93.92 ns 88.70 ns 0.94 0.00 True
390.22 ns 325.33 ns 0.83 0.00 True
365.97 ns 293.72 ns 0.80 0.00 True
432.50 ns 358.91 ns 0.83 0.00 True
  • [IndexOfString - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/ubuntu 22.04_CompilationMode=wasm_RunKind=micro/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%99%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%22%2c%20value%3a%20%22%e3%81%99%22%2c%20comparisonType%3a%20Ordinal).html>)
  • 📝 - Benchmark Source
  • ADX - Test Multi Config Graph
 147.81 ns 127.74 ns 0.86 0.00 True
1.13 μs 1.03 μs 0.91 0.00 True
  • [IndexOfString - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/ubuntu 22.04_CompilationMode=wasm_RunKind=micro/System.Memory.ReadOnlySpan.IndexOfString(input%3a%20%22%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0%e3%81%a0.html>)
  • 📝 - Benchmark Source
  • ADX - Test Multi Config Graph
 389.37 ns 324.29 ns 0.83 0.00 True
159.72 ns 125.22 ns 0.78 0.00 True
478.09 ns 386.04 ns 0.81 0.00 True
148.70 ns 124.90 ns 0.84 0.00 True
251.77 ns 210.69 ns 0.84 0.00 True
416.19 ns 379.97 ns 0.91 0.00 True
221.34 ns 183.80 ns 0.83 0.00 True
184.70 ns 154.50 ns 0.84 0.00 True

graph graph graph graph graph graph graph graph graph graph graph graph Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'
### System.Memory.ReadOnlySpan.Trim(input: " abcdefg ") #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 88.69775688985585 < 89.00993048802394. IsImprovementStdDev: Marked as improvement because 5.566135629781188 (TBase) = (93.33818351024784 -86.44351274425944) / Math.Sqrt((2.8361040995985163 / (19)) + (6.92531952382819 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.07386763387388426 = (93.33818351024784 - 86.44351274425944) / 93.33818351024784 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "X", comparisonType: Ordinal) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 325.3293494291266 < 370.03948073094824. IsImprovementStdDev: Marked as improvement because 22.432427794623663 (TBase) = (390.35212078979515 -312.28708717667234) / Math.Sqrt((5.76018408690598 / (18)) + (58.95223568631968 / (5))) is greater than 2.079613844716804 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (5) - 2, .975) and 0.19998619055834688 = (390.35212078979515 - 312.28708717667234) / 390.35212078979515 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 293.71638444775846 < 345.2578261964091. IsImprovementStdDev: Marked as improvement because 17.41423576507148 (TBase) = (364.5249943959581 -297.02400181190234) / Math.Sqrt((27.74682929216967 / (19)) + (67.8226834610608 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18517521053915484 = (364.5249943959581 - 297.02400181190234) / 364.5249943959581 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 358.91024395901576 < 409.7384116455358. IsImprovementStdDev: Marked as improvement because 33.3449097362224 (TBase) = (432.0471764382822 -357.45881782888944) / Math.Sqrt((32.66083121186158 / (19)) + (16.423068856833947 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17263938448640148 = (432.0471764382822 - 357.45881782888944) / 432.0471764382822 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだすだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "す", comparisonType: Ordinal) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 127.73897596796799 < 141.17005133177963. IsImprovementStdDev: Marked as improvement because 13.106664782714853 (TBase) = (149.05732365234581 -120.9361300687926) / Math.Sqrt((2.523624103404965 / (19)) + (22.353121731672548 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18866026099557343 = (149.05732365234581 - 120.9361300687926) / 149.05732365234581 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: InvariantCultureIgnoreCase) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 1.0329042995351276 < 1.0640042124552203. IsImprovementStdDev: Marked as improvement because 11.55529609063499 (TBase) = (1122.9830273408647 -987.0947912403888) / Math.Sqrt((90.70128501125262 / (19)) + (667.5984192504009 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.12100649145361404 = (1122.9830273408647 - 987.0947912403888) / 1122.9830273408647 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだxだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "x", comparisonType: Ordinal) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 324.28861915203817 < 370.0145165145188. IsImprovementStdDev: Marked as improvement because 20.78865583067877 (TBase) = (391.01717485968777 -309.1072075332631) / Math.Sqrt((8.762460168001862 / (19)) + (75.3171372707971 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.20947920601139114 = (391.01717485968777 - 309.1072075332631) / 391.01717485968777 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!", value: "y", comparisonType: Ordinal) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 125.2164809759528 < 142.011710060736. IsImprovementStdDev: Marked as improvement because 17.075381629867252 (TBase) = (151.0392964537076 -122.3822514090385) / Math.Sqrt((13.68430413213664 / (19)) + (10.481763569356044 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.18973237903986312 = (151.0392964537076 - 122.3822514090385) / 151.0392964537076 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 386.0363311911303 < 444.21127460202473. IsImprovementStdDev: Marked as improvement because 29.401911678406517 (TBase) = (466.9349852585477 -384.5560018215182) / Math.Sqrt((67.21831632131588 / (19)) + (21.56205959691955 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17642495430368166 = (466.9349852585477 - 384.5560018215182) / 466.9349852585477 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "w", comparisonType: OrdinalIgnoreCase) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 124.89633502694043 < 139.9090425701676. IsImprovementStdDev: Marked as improvement because 9.720822094499441 (TBase) = (148.71694079134687 -125.67564874961943) / Math.Sqrt((6.794934233029727 / (19)) + (26.303536749768224 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.15493387585248194 = (148.71694079134687 - 125.67564874961943) / 148.71694079134687 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "More Test's", value: "Tests", comparisonType: OrdinalIgnoreCase) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 210.69328092264485 < 239.23219081403235. IsImprovementStdDev: Marked as improvement because 24.055284220881532 (TBase) = (251.67837762349217 -214.43174733181235) / Math.Sqrt((7.08412591916259 / (19)) + (10.123101084031411 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1479929688175292 = (251.67837762349217 - 214.43174733181235) / 251.67837762349217 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 379.9686121285002 < 394.34949157630336. IsImprovementStdDev: Marked as improvement because 6.236863372365198 (TBase) = (413.81251308635075 -354.92099668895344) / Math.Sqrt((21.97139310511276 / (19)) + (440.02108652646535 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.1423144891346201 = (413.81251308635075 - 354.92099668895344) / 413.81251308635075 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "~", comparisonType: Ordinal) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 183.7972677172377 < 211.54251881370183. IsImprovementStdDev: Marked as improvement because 14.91495710070274 (TBase) = (223.94369429528834 -181.0811996161277) / Math.Sqrt((22.318242268094107 / (19)) + (35.42020045960627 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.19139853351996103 = (223.94369429528834 - 181.0811996161277) / 223.94369429528834 is greater than 0.05. ``` #### JIT Disasms ### System.Memory.ReadOnlySpan.IndexOfString(input: "StrIng", value: "string", comparisonType: OrdinalIgnoreCase) #### ETL Files #### Histogram #### Description of detection logic ``` IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small. IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small. IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline. IsImprovementWindowed: Marked as improvement because 154.5026427417303 < 176.19295377428077. IsImprovementStdDev: Marked as improvement because 23.44527977689377 (TBase) = (187.84141340588351 -155.5282761653306) / Math.Sqrt((23.446539884460286 / (19)) + (3.327535352064623 / (5))) is greater than 2.0738730678945014 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (5) - 2, .975) and 0.17202349926281388 = (187.84141340588351 - 155.5282761653306) / 187.84141340588351 is greater than 0.05. ``` #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)