Open performanceautofiler[bot] opened 1 year ago
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.49 ΞΌs | 6.28 ΞΌs | 1.40 | 0.35 | False | |||
|
123.51 ns | 152.76 ns | 1.24 | 0.16 | True | |||
|
10.57 ns | 13.95 ns | 1.32 | 0.50 | True | |||
|
41.50 ns | 48.80 ns | 1.18 | 0.36 | False | |||
|
9.38 ns | 14.06 ns | 1.50 | 0.39 | True | |||
|
9.10 ns | 13.96 ns | 1.53 | 0.49 | True | |||
|
108.74 ns | 121.31 ns | 1.12 | 0.10 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
1.42 ΞΌs | 1.54 ΞΌs | 1.08 | 0.45 | False | |||
|
1.19 ΞΌs | 1.29 ΞΌs | 1.09 | 0.29 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
54.99 ΞΌs | 58.32 ΞΌs | 1.06 | 0.02 | False | |||
|
54.50 ΞΌs | 57.87 ΞΌs | 1.06 | 0.06 | False | |||
|
19.91 ΞΌs | 21.92 ΞΌs | 1.10 | 0.05 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'IfStatements.IfStatements*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
17.74 ns | 19.81 ns | 1.12 | 0.17 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Char>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.83 ΞΌs | 5.71 ΞΌs | 1.18 | 0.15 | False | |||
|
687.85 ns | 800.33 ns | 1.16 | 0.04 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<Int32>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
1.57 ΞΌs | 1.69 ΞΌs | 1.07 | 0.18 | False | |||
|
1.34 ΞΌs | 1.45 ΞΌs | 1.08 | 0.26 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.52 ns | 4.60 ns | 1.31 | 0.13 | True | |||
|
3.52 ns | 4.58 ns | 1.30 | 0.07 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
109.67 ΞΌs | 131.32 ΞΌs | 1.20 | 0.03 | False | |||
|
1.18 ms | 2.43 ms | 2.05 | 0.08 | False | |||
|
161.07 ΞΌs | 182.12 ΞΌs | 1.13 | 0.28 | False | |||
|
109.60 ΞΌs | 131.33 ΞΌs | 1.20 | 0.04 | False | |||
|
2.30 ms | 2.50 ms | 1.08 | 0.04 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
25.56 ns | 27.71 ns | 1.08 | 0.29 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
1.94 ms | 2.07 ms | 1.07 | 0.25 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
172.61 ns | 250.49 ns | 1.45 | 0.42 | False | |||
|
183.57 ns | 226.99 ns | 1.24 | 0.52 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen<Int16>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.53 ns | 3.65 ns | 1.44 | 0.23 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryReaderTests*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
34.03 ΞΌs | 38.43 ΞΌs | 1.13 | 0.27 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDXposMatrix*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
20.66 ns | 23.39 ns | 1.13 | 0.16 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests<Char>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.69 ΞΌs | 4.39 ΞΌs | 1.19 | 0.18 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
7.04 ns | 8.28 ns | 1.18 | 0.19 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | 963954a11c1beeea4ad63002084a213d8d742864 |
Compare | 1185d19592d2a3f2ae79bd6cb0d7503db09b7d1d |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
16.99 ΞΌs | 18.55 ΞΌs | 1.09 | 0.01 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrueComparer<Int32>*'
Most of these regressions point to https://github.com/dotnet/runtime/compare/e4df4329df8e78c21530ae1f4af32dd87e950825...0eb038e3bdb417dd3f97f64134f5d259cc246711. That's nth-time I saw this commit range. Could it be that i.e. https://github.com/dotnet/runtime/pull/91937 confused static PGO?
cc @AndyAyersMS
Run Information
Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Byte>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_BitOperations
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in Benchstone.BenchI.XposMatrix
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Tests.Perf_String
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md