Open performanceautofiler[bot] opened 2 months ago
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 62835af00823d0f4d4138744dec90e65579f2e69 |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.23 ns | 6.34 ns | 1.96 | 0.56 | False | |||
|
10.43 ns | 15.52 ns | 1.49 | 0.33 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
374.49 ns | 432.21 ns | 1.15 | 0.20 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
26.67 ns | 28.04 ns | 1.05 | 0.27 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Byte>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.26 ns | 6.51 ns | 2.00 | 0.55 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 62835af00823d0f4d4138744dec90e65579f2e69 |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.23 ns | 7.84 ns | 1.85 | 0.55 | False | |||
|
3.16 ns | 5.68 ns | 1.80 | 0.49 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
8.79 ns | 11.18 ns | 1.27 | 0.51 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Lazy*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.79 ns | 5.52 ns | 1.46 | 0.54 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 62835af00823d0f4d4138744dec90e65579f2e69 |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
6.44 ns | 11.60 ns | 1.80 | 0.52 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
32.47 ns | 37.13 ns | 1.14 | 0.38 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorDefaultSize<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
60.36 ns | 68.84 ns | 1.14 | 0.35 | False | |||
|
43.52 ns | 59.22 ns | 1.36 | 0.37 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
19.90 μs | 23.19 μs | 1.17 | 0.18 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<Int32, Int32>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 205adaee20a873243076dee3ef66ad70e0ee563f |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.95 ns | 5.27 ns | 1.79 | 0.48 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'
Name | Value |
---|---|
Architecture | x64 |
OS | ubuntu 22.04 |
Queue | TigerUbuntu |
Baseline | f402418aaed508c1d77e41b942e3978675183bfc |
Compare | 62835af00823d0f4d4138744dec90e65579f2e69 |
Diff | Diff |
Configs | AOT:true, CompilationMode:wasm, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
16.27 ns | 19.37 ns | 1.19 | 0.33 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'
@lambdageek possibly https://github.com/dotnet/runtime/pull/106660 @kg could that be jiterpreter part of above PR?
@kg ptal /cc @steveisok
there are also 14 improvements in https://github.com/dotnet/perf-autofiling-issues/issues/40376
I wonder if always using atomic instructions is penalizing ST perf
None of this is concurrency code and it's AOT, so I don't see how jiterpreter atomics could be responsible.
Oh you're right. I missed this was AOT.
If these benchmarks don't have any interlocked ops, the regression seems unlikely to be due to my PR.
@radekdoulik unassign me, please. I don't have permissions anymore
Run Information
Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_Vector2
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_VectorOf<Single>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_Matrix3x2
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Constructor
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Collections.Perf_SingleCharFrozenDictionary
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Memory.Span<Int32>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in GuardedDevirtualization.TwoClassInterface
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Char>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md