Closed performanceautofiler[bot] closed 5 months ago
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
5.05 ns | 20.76 ns | 4.11 | 0.17 | True | |||
|
3.80 μs | 12.76 μs | 3.36 | 0.04 | True | |||
|
6.50 ns | 13.87 ns | 2.13 | 0.11 | True | |||
|
5.60 ns | 15.60 ns | 2.79 | 0.18 | True | |||
|
4.98 ns | 12.16 ns | 2.44 | 0.25 | True | |||
|
10.61 ns | 24.53 ns | 2.31 | 0.20 | True | |||
|
14.18 ns | 23.09 ns | 1.63 | 0.17 | True | |||
|
3.62 ns | 9.36 ns | 2.58 | 0.25 | True | |||
|
9.79 ns | 24.35 ns | 2.49 | 0.45 | True | |||
|
209.99 ns | 1.22 μs | 5.82 | 0.01 | True | |||
|
5.88 ns | 8.60 ns | 1.46 | 0.19 | True | |||
|
614.93 ns | 1.31 μs | 2.13 | 0.18 | True | |||
|
55.07 ns | 104.19 ns | 1.89 | 0.13 | True | |||
|
6.99 ns | 17.71 ns | 2.53 | 0.13 | True | |||
|
3.79 μs | 12.86 μs | 3.39 | 0.01 | True | |||
|
51.47 ns | 110.19 ns | 2.14 | 0.02 | True | |||
|
211.01 ns | 1.22 μs | 5.81 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.08 μs | 4.29 μs | 1.39 | 0.03 | False | |||
|
213.80 ns | 312.16 ns | 1.46 | 0.04 | False | |||
|
197.44 μs | 218.48 μs | 1.11 | 0.02 | False | |||
|
2.73 μs | 3.38 μs | 1.24 | 0.17 | True | |||
|
171.93 ns | 257.38 ns | 1.50 | 0.03 | False | |||
|
51.92 μs | 66.87 μs | 1.29 | 0.03 | False | |||
|
43.78 μs | 55.38 μs | 1.26 | 0.03 | False | |||
|
777.77 μs | 888.87 μs | 1.14 | 0.15 | False | |||
|
4.77 μs | 6.24 μs | 1.31 | 0.03 | False | |||
|
588.49 μs | 640.07 μs | 1.09 | 0.09 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.67 μs | 8.11 μs | 3.04 | 0.03 | True | |||
|
2.71 μs | 8.15 μs | 3.00 | 0.01 | True | |||
|
634.28 ns | 2.11 μs | 3.32 | 0.01 | True | |||
|
190.59 ns | 591.69 ns | 3.10 | 0.01 | True | |||
|
148.31 ns | 365.09 ns | 2.46 | 0.01 | True | |||
|
59.16 ns | 187.15 ns | 3.16 | 0.35 | True | |||
|
2.65 μs | 8.01 μs | 3.02 | 0.01 | True | |||
|
2.70 μs | 8.22 μs | 3.04 | 0.01 | True | |||
|
160.15 ns | 491.91 ns | 3.07 | 0.01 | True | |||
|
116.08 ns | 285.64 ns | 2.46 | 0.01 | True | |||
|
2.66 μs | 8.11 μs | 3.05 | 0.01 | True | |||
|
709.79 ns | 2.27 μs | 3.20 | 0.01 | True | |||
|
145.53 ns | 438.53 ns | 3.01 | 0.01 | True | |||
|
151.60 ns | 482.55 ns | 3.18 | 0.01 | True | |||
|
2.73 μs | 8.22 μs | 3.01 | 0.01 | True | |||
|
66.75 ns | 201.96 ns | 3.03 | 0.01 | True | |||
|
677.57 ns | 2.20 μs | 3.25 | 0.01 | True | |||
|
69.79 ns | 196.92 ns | 2.82 | 0.01 | True | |||
|
623.39 ns | 2.10 μs | 3.37 | 0.01 | True | |||
|
631.37 ns | 2.10 μs | 3.33 | 0.01 | True | |||
|
623.66 ns | 2.07 μs | 3.33 | 0.03 | True | |||
|
63.00 ns | 175.50 ns | 2.79 | 0.41 | True | |||
|
202.13 ns | 592.48 ns | 2.93 | 0.03 | True | |||
|
222.43 ns | 650.54 ns | 2.92 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.12 ns | 10.27 ns | 2.49 | 0.31 | True | |||
|
1.93 ns | 6.70 ns | 3.47 | 0.28 | True | |||
|
11.24 ns | 14.33 ns | 1.27 | 0.06 | False | |||
|
2.67 ns | 5.25 ns | 1.97 | 0.14 | True | |||
|
12.12 ns | 13.42 ns | 1.11 | 0.09 | False | |||
|
2.44 ns | 6.87 ns | 2.81 | 0.15 | False | |||
|
4.85 ns | 13.16 ns | 2.71 | 0.08 | True | |||
|
4.77 ns | 13.17 ns | 2.76 | 0.14 | True | |||
|
11.09 ns | 19.91 ns | 1.79 | 0.10 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
151.12 ns | 352.59 ns | 2.33 | 0.45 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
551.46 ns | 1.55 μs | 2.81 | 0.26 | True | |||
|
6.85 μs | 13.69 μs | 2.00 | 0.05 | True | |||
|
230.92 ns | 1.38 μs | 5.99 | 0.01 | True | |||
|
13.44 ns | 16.43 ns | 1.22 | 0.45 | False | |||
|
309.10 ns | 533.07 ns | 1.72 | 0.01 | True | |||
|
303.51 ns | 1.01 μs | 3.32 | 0.36 | True | |||
|
11.31 ns | 15.77 ns | 1.39 | 0.39 | True | |||
|
133.02 ns | 195.27 ns | 1.47 | 0.18 | True | |||
|
35.27 ns | 85.52 ns | 2.43 | 0.02 | True | |||
|
35.44 ns | 85.24 ns | 2.41 | 0.01 | True | |||
|
1.04 μs | 1.89 μs | 1.81 | 0.18 | True | |||
|
59.85 ns | 108.44 ns | 1.81 | 0.07 | True | |||
|
49.12 ns | 78.51 ns | 1.60 | 0.48 | True | |||
|
18.84 ns | 60.81 ns | 3.23 | 0.55 | True | |||
|
26.05 ns | 73.49 ns | 2.82 | 0.06 | True | |||
|
91.36 ns | 113.20 ns | 1.24 | 0.20 | False | |||
|
79.91 ns | 164.03 ns | 2.05 | 0.02 | True | |||
|
293.65 ns | 1.01 μs | 3.43 | 0.35 | True | |||
|
100.70 ns | 116.55 ns | 1.16 | 0.45 | False | |||
|
4.31 ns | 16.60 ns | 3.85 | 0.47 | True | |||
|
36.53 ns | 85.56 ns | 2.34 | 0.05 | True | |||
|
227.78 ns | 595.30 ns | 2.61 | 0.01 | True | |||
|
13.68 ns | 15.01 ns | 1.10 | 0.01 | True | |||
|
8.23 μs | 13.75 μs | 1.67 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
25.79 μs | 76.95 μs | 2.98 | 0.01 | True | |||
|
782.53 ns | 1.82 μs | 2.33 | 0.01 | True | |||
|
10.60 μs | 27.56 μs | 2.60 | 0.01 | True | |||
|
4.30 ms | 10.57 ms | 2.46 | 0.01 | True | |||
|
49.57 μs | 121.16 μs | 2.44 | 0.01 | True | |||
|
735.20 ns | 1.75 μs | 2.38 | 0.01 | True | |||
|
44.43 μs | 124.33 μs | 2.80 | 0.01 | True | |||
|
55.36 μs | 142.96 μs | 2.58 | 0.01 | True | |||
|
8.47 μs | 20.38 μs | 2.41 | 0.01 | True | |||
|
9.72 μs | 22.43 μs | 2.31 | 0.01 | True | |||
|
9.14 μs | 24.29 μs | 2.66 | 0.01 | True | |||
|
37.09 μs | 93.48 μs | 2.52 | 0.01 | True | |||
|
4.84 ms | 11.58 ms | 2.40 | 0.01 | True | |||
|
43.78 μs | 108.39 μs | 2.48 | 0.01 | True | |||
|
5.28 μs | 12.69 μs | 2.40 | 0.01 | True | |||
|
5.84 μs | 13.86 μs | 2.37 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
601.66 ns | 1.00 μs | 1.67 | 0.01 | True | |||
|
23.94 μs | 39.03 μs | 1.63 | 0.01 | True | |||
|
37.61 ns | 77.60 ns | 2.06 | 0.13 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
138.01 ns | 177.15 ns | 1.28 | 0.28 | True | |||
|
158.22 ns | 211.37 ns | 1.34 | 0.13 | True | |||
|
88.80 ns | 97.86 ns | 1.10 | 0.03 | True | |||
|
88.35 ns | 117.77 ns | 1.33 | 0.32 | True | |||
|
59.16 ns | 62.60 ns | 1.06 | 0.11 | False | |||
|
118.42 ns | 128.53 ns | 1.09 | 0.06 | False | |||
|
310.54 ns | 391.30 ns | 1.26 | 0.01 | True | |||
|
418.22 ns | 515.08 ns | 1.23 | 0.01 | True | |||
|
124.71 ns | 164.28 ns | 1.32 | 0.25 | True | |||
|
97.57 ns | 123.86 ns | 1.27 | 0.19 | True | |||
|
175.65 ns | 228.43 ns | 1.30 | 0.32 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
154.49 ns | 265.46 ns | 1.72 | 0.45 | True | |||
|
2.73 μs | 5.14 μs | 1.89 | 0.01 | True | |||
|
71.35 ns | 114.84 ns | 1.61 | 0.44 | True | |||
|
103.33 ns | 128.85 ns | 1.25 | 0.41 | True | |||
|
346.27 ns | 1.19 μs | 3.42 | 0.49 | True | |||
|
45.99 ns | 119.25 ns | 2.59 | 0.09 | True | |||
|
503.68 ns | 996.18 ns | 1.98 | 0.25 | True | |||
|
162.91 ns | 171.53 ns | 1.05 | 0.48 | False | |||
|
14.98 μs | 20.30 μs | 1.36 | 0.07 | True | |||
|
4.22 μs | 6.88 μs | 1.63 | 0.58 | True | |||
|
104.56 ns | 148.58 ns | 1.42 | 0.32 | True | |||
|
8.16 ns | 11.99 ns | 1.47 | 0.30 | True | |||
|
15.96 ns | 60.54 ns | 3.79 | 0.03 | True | |||
|
197.04 ns | 223.15 ns | 1.13 | 0.01 | True | |||
|
159.52 ns | 276.40 ns | 1.73 | 0.36 | True | |||
|
223.36 ns | 564.47 ns | 2.53 | 0.52 | True | |||
|
13.36 ns | 17.34 ns | 1.30 | 0.05 | True | |||
|
141.81 ns | 208.02 ns | 1.47 | 0.24 | True | |||
|
70.34 ns | 118.08 ns | 1.68 | 0.50 | True | |||
|
7.61 ns | 24.73 ns | 3.25 | 0.42 | True | |||
|
681.02 ns | 2.34 μs | 3.44 | 0.44 | True | |||
|
1.54 μs | 2.37 μs | 1.54 | 0.07 | True | |||
|
54.41 ns | 149.81 ns | 2.75 | 0.63 | True | |||
|
38.60 ns | 43.21 ns | 1.12 | 0.01 | True | |||
|
48.48 ns | 110.76 ns | 2.28 | 0.13 | True | |||
|
7.98 ns | 13.49 ns | 1.69 | 0.25 | True | |||
|
1.30 μs | 1.48 μs | 1.13 | 0.14 | False | |||
|
411.13 ns | 461.39 ns | 1.12 | 0.31 | False | |||
|
159.10 ns | 189.91 ns | 1.19 | 0.46 | False | |||
|
9.11 ns | 40.66 ns | 4.46 | 0.17 | True | |||
|
8.72 ns | 26.67 ns | 3.06 | 0.47 | True | |||
|
81.64 ns | 108.62 ns | 1.33 | 0.39 | False | |||
|
29.97 ns | 36.45 ns | 1.22 | 0.55 | False | |||
|
960.44 ns | 3.63 μs | 3.78 | 0.40 | True | |||
|
159.77 ns | 403.06 ns | 2.52 | 0.47 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-c5c5495d-d526-4ac0-9429-f1d96603c653a9746fa7885420fb2/ebc5d8b6-879e-47f0-97b5-846b51746709.zip?sv=2021-08-06&se=2024-03-20T11%3A51%3A36Z&sr=c&sp=rl&sig=jzWZcVcYoilZW5o16%2FvL01sFfzphNwP%2FRk0UoSI0ECA%3D) Compare
Profiling workflow for dotnet/runtime repository Benchmarking workflow for dotnet/runtime repository
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
11.35 ns | 18.49 ns | 1.63 | 0.06 | True | |||
|
10.45 ns | 18.38 ns | 1.76 | 0.38 | True | |||
|
9.81 ns | 15.57 ns | 1.59 | 0.24 | True | |||
|
7.25 ns | 10.56 ns | 1.46 | 0.12 | True | |||
|
7.12 ns | 10.05 ns | 1.41 | 0.06 | True | |||
|
8.72 ns | 17.88 ns | 2.05 | 0.16 | True | |||
|
12.05 ns | 21.04 ns | 1.75 | 0.08 | True | |||
|
5.24 ns | 11.06 ns | 2.11 | 0.11 | True | |||
|
10.44 ns | 16.84 ns | 1.61 | 0.25 | True | |||
|
18.28 ns | 31.92 ns | 1.75 | 0.11 | True | |||
|
12.89 ns | 26.28 ns | 2.04 | 0.12 | True | |||
|
16.02 ns | 29.81 ns | 1.86 | 0.10 | True | |||
|
6.30 ns | 11.41 ns | 1.81 | 0.15 | True | |||
|
106.13 ns | 191.51 ns | 1.80 | 0.01 | True | |||
|
113.32 ns | 220.07 ns | 1.94 | 0.01 | True | |||
|
38.03 ns | 67.40 ns | 1.77 | 0.01 | True | |||
|
32.63 ns | 64.01 ns | 1.96 | 0.04 | True | |||
|
11.58 ns | 19.44 ns | 1.68 | 0.19 | True | |||
|
15.77 ns | 41.66 ns | 2.64 | 0.31 | True | |||
|
11.38 ns | 18.57 ns | 1.63 | 0.45 | True | |||
|
9.94 ns | 18.16 ns | 1.83 | 0.44 | True | |||
|
5.71 ns | 11.67 ns | 2.04 | 0.09 | True | |||
|
8.63 ns | 18.00 ns | 2.08 | 0.08 | True | |||
|
70.89 ns | 124.19 ns | 1.75 | 0.02 | True | |||
|
7.00 ns | 9.64 ns | 1.38 | 0.25 | True | |||
|
12.85 ns | 20.23 ns | 1.57 | 0.03 | True | |||
|
7.21 ns | 10.14 ns | 1.41 | 0.16 | True | |||
|
6.73 ns | 9.90 ns | 1.47 | 0.07 | True | |||
|
65.83 ns | 121.35 ns | 1.84 | 0.01 | True | |||
|
5.61 ns | 11.16 ns | 1.99 | 0.14 | True | |||
|
17.02 ns | 30.29 ns | 1.78 | 0.14 | True | |||
|
8.97 ns | 13.13 ns | 1.46 | 0.07 | True | |||
|
16.61 ns | 31.22 ns | 1.88 | 0.30 | True | |||
|
11.13 ns | 18.03 ns | 1.62 | 0.06 | True | |||
|
37.04 ns | 80.83 ns | 2.18 | 0.01 | True | |||
|
12.49 ns | 24.36 ns | 1.95 | 0.23 | True | |||
|
5.25 ns | 11.14 ns | 2.12 | 0.17 | True | |||
|
85.54 ns | 117.97 ns | 1.38 | 0.02 | True | |||
|
103.37 ns | 184.31 ns | 1.78 | 0.02 | True | |||
|
8.25 ns | 10.10 ns | 1.22 | 0.05 | False | |||
|
38.13 ns | 81.48 ns | 2.14 | 0.01 | True | |||
|
116.30 ns | 227.50 ns | 1.96 | 0.01 | True |
fers.Text.Tests.Utf8ParserTests_18.png>)
Test Report
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
10.80 μs | 34.70 μs | 3.21 | 0.21 | True | |||
|
984.27 ns | 1.30 μs | 1.32 | 0.05 | True | |||
|
2.34 μs | 3.12 μs | 1.33 | 0.32 | True | |||
|
243.23 ns | 365.86 ns | 1.50 | 0.05 | True | |||
|
443.78 ns | 699.29 ns | 1.58 | 0.02 | True | |||
|
20.03 μs | 52.62 μs | 2.63 | 0.27 | True | |||
|
161.39 ns | 358.59 ns | 2.22 | 0.32 | True | |||
|
947.77 ns | 1.21 μs | 1.28 | 0.06 | True | |||
|
1.32 μs | 1.48 μs | 1.12 | 0.37 | False | |||
|
180.02 ns | 323.48 ns | 1.80 | 0.45 | True | |||
|
564.76 ns | 708.78 ns | 1.26 | 0.20 | False | |||
|
997.39 ns | 1.57 μs | 1.57 | 0.23 | True | |||
|
986.56 ns | 1.36 μs | 1.38 | 0.06 | True | |||
|
783.79 ns | 1.15 μs | 1.47 | 0.34 | True | |||
|
447.16 ns | 646.21 ns | 1.45 | 0.38 | True | |||
|
1.46 μs | 1.82 μs | 1.24 | 0.02 | True | |||
|
1.40 μs | 1.79 μs | 1.28 | 0.07 | True | |||
|
228.99 ns | 333.94 ns | 1.46 | 0.06 | True | |||
|
1.25 μs | 1.95 μs | 1.56 | 0.09 | True | |||
|
659.67 ns | 728.91 ns | 1.10 | 0.25 | False | |||
|
621.27 ns | 739.18 ns | 1.19 | 0.27 | True | |||
|
30.74 μs | 79.39 μs | 2.58 | 0.01 | True | |||
|
1.04 μs | 1.44 μs | 1.38 | 0.10 | True | |||
|
653.95 ns | 880.65 ns | 1.35 | 0.28 | True | |||
|
2.45 μs | 3.76 μs | 1.54 | 0.24 | True | |||
|
244.23 ns | 368.58 ns | 1.51 | 0.05 | True | |||
|
476.05 ns | 669.30 ns | 1.41 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.99 ns | 4.94 ns | 1.65 | 0.05 | True | |||
|
1.34 ns | 3.04 ns | 2.27 | 0.05 | True | |||
|
2.61 ns | 4.46 ns | 1.71 | 0.05 | True | |||
|
3.01 ns | 4.61 ns | 1.53 | 0.10 | True | |||
|
2.84 ns | 4.16 ns | 1.47 | 0.06 | True | |||
|
2.83 ns | 4.29 ns | 1.52 | 0.10 | True | |||
|
2.78 ns | 4.64 ns | 1.67 | 0.05 | True | |||
|
2.51 ns | 4.51 ns | 1.80 | 0.04 | True | |||
|
2.65 ns | 4.91 ns | 1.85 | 0.05 | True | |||
|
2.45 ns | 4.69 ns | 1.91 | 0.06 | True | |||
|
1.34 ns | 3.05 ns | 2.27 | 0.03 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
310.25 ns | 543.55 ns | 1.75 | 0.16 | True | |||
|
333.15 ns | 531.81 ns | 1.60 | 0.27 | True | |||
|
326.54 ns | 541.44 ns | 1.66 | 0.17 | True | |||
|
326.30 ns | 539.16 ns | 1.65 | 0.18 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
398.73 ns | 627.11 ns | 1.57 | 0.13 | True | |||
|
237.27 ns | 453.56 ns | 1.91 | 0.28 | True | |||
|
667.99 μs | 2.80 ms | 4.20 | 0.01 | True | |||
|
306.08 ns | 374.04 ns | 1.22 | 0.03 | True | |||
|
252.59 ns | 293.07 ns | 1.16 | 0.01 | True | |||
|
235.83 ns | 482.24 ns | 2.04 | 0.27 | True | |||
|
399.59 ns | 552.03 ns | 1.38 | 0.33 | True | |||
|
430.67 ns | 663.50 ns | 1.54 | 0.30 | True | |||
|
2.58 μs | 4.53 μs | 1.76 | 0.01 | True | |||
|
1.05 μs | 1.56 μs | 1.48 | 0.03 | True | |||
|
454.85 ns | 668.18 ns | 1.47 | 0.32 | True | |||
|
436.14 ns | 697.89 ns | 1.60 | 0.25 | True | |||
|
667.96 μs | 2.76 ms | 4.13 | 0.01 | True | |||
|
375.57 ns | 541.00 ns | 1.44 | 0.37 | True | |||
|
304.57 ns | 347.02 ns | 1.14 | 0.01 | True | |||
|
501.38 ns | 653.32 ns | 1.30 | 0.24 | True | |||
|
293.40 ns | 353.55 ns | 1.21 | 0.04 | True | |||
|
429.72 ns | 680.13 ns | 1.58 | 0.27 | True | |||
|
379.51 ns | 566.86 ns | 1.49 | 0.34 | True | |||
|
2.57 μs | 4.55 μs | 1.77 | 0.01 | True | |||
|
258.07 ns | 476.93 ns | 1.85 | 0.37 | True | |||
|
414.96 ns | 643.90 ns | 1.55 | 0.20 | True | |||
|
257.01 ns | 288.62 ns | 1.12 | 0.01 | True | |||
|
257.66 ns | 487.34 ns | 1.89 | 0.32 | True | |||
|
316.09 ns | 350.48 ns | 1.11 | 0.01 | True | |||
|
444.79 ns | 688.66 ns | 1.55 | 0.16 | True | |||
|
431.19 ns | 645.23 ns | 1.50 | 0.33 | True | |||
|
531.92 ns | 710.42 ns | 1.34 | 0.21 | True | |||
|
433.45 ns | 980.32 ns | 2.26 | 0.13 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.96 ns | 6.42 ns | 2.16 | 0.65 | False | |||
|
265.11 ns | 299.18 ns | 1.13 | 0.18 | False | |||
|
233.20 ns | 275.82 ns | 1.18 | 0.22 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
713.69 μs | 825.90 μs | 1.16 | 0.04 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
821.91 ms | 1.51 secs | 1.83 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
28.29 μs | 39.70 μs | 1.40 | 0.09 | True | |||
|
804.33 μs | 905.30 μs | 1.13 | 0.40 | False | |||
|
351.20 ns | 867.91 ns | 2.47 | 0.01 | True | |||
|
692.07 μs | 841.04 μs | 1.22 | 0.25 | True | |||
|
3.20 μs | 4.12 μs | 1.29 | 0.03 | True | |||
|
6.50 μs | 8.85 μs | 1.36 | 0.02 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
3.29 μs | 7.53 μs | 2.29 | 0.37 | True | |||
|
2.90 μs | 7.56 μs | 2.61 | 0.37 | True | |||
|
3.34 μs | 7.28 μs | 2.18 | 0.45 | True | |||
|
3.12 μs | 8.94 μs | 2.87 | 0.46 | True | |||
|
11.18 μs | 16.80 μs | 1.50 | 0.36 | True | |||
|
3.00 μs | 7.24 μs | 2.42 | 0.45 | True | |||
|
11.23 μs | 15.41 μs | 1.37 | 0.10 | True | |||
|
3.05 μs | 6.95 μs | 2.28 | 0.35 | True | |||
|
11.56 μs | 16.11 μs | 1.39 | 0.25 | True | |||
|
18.85 μs | 24.97 μs | 1.32 | 0.24 | True | |||
|
11.80 μs | 15.41 μs | 1.31 | 0.13 | True | |||
|
13.36 μs | 15.81 μs | 1.18 | 0.33 | False | |||
|
3.55 μs | 7.46 μs | 2.10 | 0.47 | True | |||
|
4.06 μs | 9.50 μs | 2.34 | 0.44 | True | |||
|
19.78 μs | 25.79 μs | 1.30 | 0.12 | True | |||
|
11.85 μs | 18.46 μs | 1.56 | 0.46 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
138.89 ns | 161.29 ns | 1.16 | 0.07 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
247.50 ns | 277.59 ns | 1.12 | 0.02 | False | |||
|
251.63 ns | 286.84 ns | 1.14 | 0.04 | True | |||
|
550.07 ns | 847.41 ns | 1.54 | 0.21 | True | |||
|
34.08 μs | 91.28 μs | 2.68 | 0.01 | True | |||
|
526.61 ns | 755.86 ns | 1.44 | 0.18 | True | |||
|
549.35 ns | 836.52 ns | 1.52 | 0.21 | True | |||
|
386.24 ns | 589.43 ns | 1.53 | 0.26 | True | |||
|
501.08 ns | 824.40 ns | 1.65 | 0.24 | True | |||
|
34.05 μs | 91.19 μs | 2.68 | 0.01 | True | |||
|
380.62 ns | 415.62 ns | 1.09 | 0.01 | True | |||
|
529.08 ns | 801.01 ns | 1.51 | 0.15 | True | |||
|
280.32 ns | 488.08 ns | 1.74 | 0.37 | True | |||
|
283.26 ns | 509.21 ns | 1.80 | 0.41 | True | |||
|
388.66 ns | 438.28 ns | 1.13 | 0.02 | True | |||
|
508.08 ns | 802.22 ns | 1.58 | 0.28 | True | |||
|
668.46 μs | 2.58 ms | 3.86 | 0.01 | True | |||
|
379.98 ns | 578.14 ns | 1.52 | 0.30 | True | |||
|
409.74 ns | 581.98 ns | 1.42 | 0.26 | True | |||
|
383.08 ns | 436.88 ns | 1.14 | 0.04 | True | |||
|
668.61 μs | 2.61 ms | 3.90 | 0.01 | True | |||
|
264.91 ns | 493.11 ns | 1.86 | 0.27 | True | |||
|
376.37 ns | 454.19 ns | 1.21 | 0.02 | True | |||
|
508.48 ns | 815.17 ns | 1.60 | 0.25 | True | |||
|
531.36 ns | 837.62 ns | 1.58 | 0.15 | True | |||
|
272.68 ns | 471.09 ns | 1.73 | 0.20 | True | |||
|
512.42 ns | 768.07 ns | 1.50 | 0.17 | True | |||
|
1.09 μs | 1.64 μs | 1.50 | 0.01 | True | |||
|
469.40 ns | 1.05 μs | 2.24 | 0.18 | True | |||
|
516.46 ns | 717.73 ns | 1.39 | 0.18 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.38 ms | 7.12 ms | 2.99 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
672.59 μs | 807.12 μs | 1.20 | 0.05 | True | |||
|
401.27 μs | 500.19 μs | 1.25 | 0.12 | True | |||
|
400.97 μs | 500.86 μs | 1.25 | 0.10 | True | |||
|
401.00 μs | 498.92 μs | 1.24 | 0.20 | True | |||
|
133.73 μs | 254.43 μs | 1.90 | 0.01 | True | |||
|
133.69 μs | 254.68 μs | 1.91 | 0.02 | True | |||
|
200.48 μs | 298.82 μs | 1.49 | 0.02 | False | |||
|
267.04 μs | 404.60 μs | 1.52 | 0.02 | True | |||
|
400.83 μs | 500.99 μs | 1.25 | 0.32 | True | |||
|
401.02 μs | 501.27 μs | 1.25 | 0.08 | True | |||
|
414.04 μs | 501.17 μs | 1.21 | 0.02 | True | |||
|
400.99 μs | 501.40 μs | 1.25 | 0.10 | True | |||
|
202.66 μs | 327.68 μs | 1.62 | 0.01 | True | |||
|
208.70 μs | 300.63 μs | 1.44 | 0.02 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
53.97 ns | 70.28 ns | 1.30 | 0.35 | True | |||
|
17.22 ns | 31.54 ns | 1.83 | 0.01 | True | |||
|
452.71 ns | 822.93 ns | 1.82 | 0.33 | True | |||
|
11.98 ns | 14.89 ns | 1.24 | 0.11 | True | |||
|
414.57 ns | 662.60 ns | 1.60 | 0.48 | True | |||
|
50.08 ns | 75.64 ns | 1.51 | 0.30 | True | |||
|
231.31 ns | 538.70 ns | 2.33 | 0.47 | True | |||
|
11.38 ns | 14.87 ns | 1.31 | 0.11 | True | |||
|
78.41 ns | 248.15 ns | 3.16 | 0.01 | True | |||
|
452.01 ns | 814.21 ns | 1.80 | 0.27 | True | |||
|
66.80 ns | 97.49 ns | 1.46 | 0.24 | True | |||
|
165.29 ns | 283.11 ns | 1.71 | 0.39 | True | |||
|
397.18 ns | 653.13 ns | 1.64 | 0.38 | True | |||
|
53.86 ns | 74.00 ns | 1.37 | 0.31 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
69.72 μs | 91.10 μs | 1.31 | 0.29 | True | |||
|
29.03 μs | 41.28 μs | 1.42 | 0.05 | True | |||
|
25.69 μs | 33.81 μs | 1.32 | 0.03 | False | |||
|
27.76 μs | 39.12 μs | 1.41 | 0.06 | False | |||
|
818.49 μs | 946.27 μs | 1.16 | 0.26 | False | |||
|
26.97 μs | 37.86 μs | 1.40 | 0.35 | True | |||
|
721.72 μs | 830.11 μs | 1.15 | 0.29 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
74.87 ns | 84.06 ns | 1.12 | 0.01 | True | |||
|
31.13 ns | 39.94 ns | 1.28 | 0.05 | True | |||
|
60.58 ns | 80.70 ns | 1.33 | 0.02 | True | |||
|
35.00 ns | 45.19 ns | 1.29 | 0.07 | True | |||
|
50.67 ns | 58.30 ns | 1.15 | 0.01 | True | |||
|
46.88 ns | 55.92 ns | 1.19 | 0.01 | True | |||
|
123.52 ns | 194.39 ns | 1.57 | 0.01 | True | |||
|
90.49 ns | 113.07 ns | 1.25 | 0.45 | False | |||
|
45.40 ns | 63.72 ns | 1.40 | 0.03 | True | |||
|
13.34 ns | 16.48 ns | 1.24 | 0.26 | False | |||
|
78.11 ns | 88.08 ns | 1.13 | 0.01 | True | |||
|
80.04 ns | 130.04 ns | 1.62 | 0.06 | True | |||
|
30.38 ns | 38.06 ns | 1.25 | 0.05 | True | |||
|
72.15 ns | 80.71 ns | 1.12 | 0.01 | True | |||
|
78.09 ns | 90.80 ns | 1.16 | 0.41 | False | |||
|
120.62 ns | 194.37 ns | 1.61 | 0.02 | True | |||
|
76.01 ns | 128.50 ns | 1.69 | 0.01 | True | |||
|
70.97 ns | 79.10 ns | 1.11 | 0.03 | True | |||
|
53.68 ns | 64.18 ns | 1.20 | 0.01 | True | |||
|
76.45 ns | 86.80 ns | 1.14 | 0.01 | True | |||
|
35.47 ns | 46.72 ns | 1.32 | 0.02 | True | |||
|
51.91 ns | 55.73 ns | 1.07 | 0.01 | False | |||
|
73.72 ns | 81.65 ns | 1.11 | 0.03 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.45 ns | 24.43 ns | 5.49 | 0.13 | True | |||
|
6.52 ns | 76.17 ns | 11.68 | 0.37 | True | |||
|
6.55 ns | 77.28 ns | 11.79 | 0.40 | True | |||
|
4.14 ns | 24.42 ns | 5.90 | 0.15 | True | |||
|
6.56 ns | 76.97 ns | 11.73 | 0.44 | True | |||
|
4.15 ns | 24.34 ns | 5.86 | 0.19 | True | |||
|
7.46 ns | 77.89 ns | 10.44 | 0.41 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
35.83 ns | 50.49 ns | 1.41 | 0.41 | True | |||
|
37.49 ns | 73.95 ns | 1.97 | 0.08 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
58.72 ns | 67.48 ns | 1.15 | 0.01 | True | |||
|
60.17 ns | 66.13 ns | 1.10 | 0.01 | True | |||
|
62.82 ns | 73.02 ns | 1.16 | 0.02 | True | |||
|
33.13 ns | 44.63 ns | 1.35 | 0.03 | True | |||
|
31.27 ns | 38.40 ns | 1.23 | 0.06 | True | |||
|
63.10 ns | 74.08 ns | 1.17 | 0.02 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
836.69 μs | 2.55 ms | 3.05 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
4.34 ns | 33.39 ns | 7.70 | 0.08 | True | |||
|
0.34 ns | 5.05 ns | 14.72 | 0.32 | True | |||
|
0.33 ns | 9.74 ns | 29.27 | 0.22 | True | |||
|
54.42 ns | 91.52 ns | 1.68 | 0.25 | True | |||
|
0.33 ns | 5.17 ns | 15.83 | 0.29 | True | |||
|
0.33 ns | 3.74 ns | 11.46 | 0.28 | True | |||
|
1.39 ns | 33.92 ns | 24.44 | 0.16 | True | |||
|
0.38 ns | 21.46 ns | 55.75 | 0.24 | True | |||
|
0.32 ns | 14.87 ns | 45.84 | 0.26 | True | |||
|
7.76 ns | 40.06 ns | 5.17 | 0.01 | True | |||
|
0.34 ns | 5.31 ns | 15.74 | 0.23 | True | |||
|
0.39 ns | 5.14 ns | 13.29 | 0.29 | True | |||
|
22.73 ns | 125.44 ns | 5.52 | 0.06 | True | |||
|
13.40 ns | 47.32 ns | 3.53 | 0.01 | True | |||
|
0.33 ns | 6.24 ns | 18.75 | 0.14 | False | |||
|
0.37 ns | 33.50 ns | 91.71 | 0.30 | True | |||
|
0.34 ns | 5.54 ns | 16.37 | 0.24 | True | |||
|
22.10 ns | 125.14 ns | 5.66 | 0.05 | True | |||
|
0.34 ns | 5.15 ns | 15.14 | 0.34 | True | |||
|
19.32 ns | 43.23 ns | 2.24 | 0.23 | True | |||
|
0.34 ns | 14.79 ns | 43.81 | 0.16 | True | |||
|
13.82 ns | 52.52 ns | 3.80 | 0.04 | True | |||
|
1.20 ns | 6.17 ns | 5.15 | 0.34 | True | |||
|
0.33 ns | 5.24 ns | 15.68 | 0.25 | True | |||
|
0.33 ns | 14.56 ns | 43.82 | 0.32 | True | |||
|
0.33 ns | 5.26 ns | 15.91 | 0.32 | True | |||
|
13.38 ns | 47.04 ns | 3.52 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
26.76 μs | 102.89 μs | 3.85 | 0.04 | True | |||
|
36.10 μs | 110.59 μs | 3.06 | 0.01 | True | |||
|
20.06 μs | 131.97 μs | 6.58 | 0.01 | True | |||
|
16.71 μs | 118.79 μs | 7.11 | 0.01 | True | |||
|
16.72 μs | 119.71 μs | 7.16 | 0.01 | True | |||
|
4.50 ns | 94.29 μs | 20960.32 | 0.08 | True | |||
|
13.37 μs | 104.68 μs | 7.83 | 0.01 | True | |||
|
36.14 μs | 111.21 μs | 3.08 | 0.01 | True | |||
|
13.38 μs | 108.25 μs | 8.09 | 0.01 | True | |||
|
16.72 μs | 123.41 μs | 7.38 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
107.90 ms | 229.95 ms | 2.13 | 0.25 | True | |||
|
116.20 ms | 220.50 ms | 1.90 | 0.28 | True | |||
|
111.51 ms | 221.57 ms | 1.99 | 0.30 | True | |||
|
111.48 ms | 218.49 ms | 1.96 | 0.26 | True | |||
|
109.36 ms | 220.92 ms | 2.02 | 0.37 | True | |||
|
113.44 ms | 219.71 ms | 1.94 | 0.30 | True | |||
|
104.50 ms | 222.00 ms | 2.12 | 0.29 | True | |||
|
119.90 ms | 223.39 ms | 1.86 | 0.26 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
528.04 ns | 2.55 μs | 4.83 | 0.05 | True | |||
|
476.19 ns | 959.76 ns | 2.02 | 0.01 | True | |||
|
518.62 ns | 2.46 μs | 4.73 | 0.05 | True | |||
|
91.35 ns | 340.54 ns | 3.73 | 0.15 | True | |||
|
544.35 ns | 2.52 μs | 4.62 | 0.05 | True | |||
|
274.75 ns | 871.34 ns | 3.17 | 0.07 | True | |||
|
267.91 ns | 827.78 ns | 3.09 | 0.10 | True | |||
|
520.42 ns | 2.45 μs | 4.71 | 0.06 | True | |||
|
531.18 ns | 2.50 μs | 4.70 | 0.05 | True | |||
|
56.74 ns | 86.21 ns | 1.52 | 0.01 | True | |||
|
80.20 ns | 321.96 ns | 4.01 | 0.02 | True | |||
|
412.46 ns | 843.95 ns | 2.05 | 0.01 | True | |||
|
90.03 ns | 327.17 ns | 3.63 | 0.08 | True | |||
|
83.38 ns | 313.27 ns | 3.76 | 0.06 | True | |||
|
5.76 ns | 18.09 ns | 3.14 | 0.03 | True | |||
|
530.29 ns | 2.46 μs | 4.63 | 0.09 | True | |||
|
548.79 ns | 2.55 μs | 4.64 | 0.05 | True | |||
|
532.81 ns | 2.46 μs | 4.62 | 0.03 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
13.84 ns | 18.88 ns | 1.36 | 0.05 | True | |||
|
1.50 ns | 2.61 ns | 1.74 | 0.01 | True | |||
|
2.74 ns | 4.60 ns | 1.68 | 0.01 | True | |||
|
9.81 ns | 13.44 ns | 1.37 | 0.08 | True | |||
|
6.70 ns | 9.69 ns | 1.45 | 0.05 | True | |||
|
8.41 ns | 11.40 ns | 1.36 | 0.09 | True | |||
|
6.68 ns | 7.70 ns | 1.15 | 0.03 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
343.19 ns | 424.27 ns | 1.24 | 0.38 | False | |||
|
171.02 ns | 197.39 ns | 1.15 | 0.04 | True | |||
|
665.47 ns | 1.14 μs | 1.72 | 0.01 | True |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 22.04 |
Queue | AmpereUbuntu |
Baseline | eeadd653e1982d7037a93a9ab38129c07336e7db |
Compare | 9dc6ea62a4d195ae4559f4609a56933c61889756 |
Diff | Diff |
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.72 μs | 3.29 μs | 1.21 | 0.24 | True | |||
|
2.09 μs | 3.13 μs | 1.50 | 0.03 | False | |||
|
155.81 ns | 231.28 ns | 1.48 | 0.03 | False | |||
|
212.01 μs | 317.79 μs | 1.50 | 0.03 | False | |||
|
13.71 μs | 16.88 μs | 1.23 | 0.03 | True | |||
|
225.33 ns | 314.87 ns | 1.40 | 0.05 | False | |||
|
21.20 μs | 32.04 μs | 1.51 | 0.05 | False | |||
|
176.51 μs | 199.39 μs | 1.13 | 0.05 | True | |||
|
15.08 μs | 23.33 μs | 1.55 | 0.04 | False | |||
|
151.75 μs | 231.17 μs | 1.52 | 0.03 | False | |||
|
1.50 μs | 2.28 μs | 1.52 | 0.03 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
broken measurements, back to original values
Run Information
Regressions in System.Tests.Perf_UInt32
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Repro Steps
#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order)) - Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0` - CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0` - AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false` - Dotnet SDK installed for dotnet commands - Running commands from the runtime folder Linux ```cmd # Set $RunDir to the runtime directory RunDir=`pwd` # Set the OS, arch, and OSId RunOS='linux' RunOSId='linux' RunArch='x64' # Create aot directory mkdir -p $RunDir/artifacts/bin/aot/sgen mkdir -p $RunDir/artifacts/bin/aot/pack cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack # Create Core Root $RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release # Clone performance git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance # One line run: python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_UInt32*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog" # Individual Commands: # Restore dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Build dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Run dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_UInt32* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200 ``` Windows ```cmd # Set $RunDir to the runtime directory $RunDir="FullPathHere" # Set the OS, arch, and OSId RunOS='windows' RunOSId='win' RunArch='x64' # Create aot directory mkdir $RunDir\artifacts\bin\aot\sgen mkdir $RunDir\artifacts\bin\aot\pack xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y # Create Core Root $RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release # Clone performance git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance # One line run: python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_UInt32*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog" # Individual Commands: # Restore dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Build dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Run dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_UInt32* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200 ```Run Information
Regressions in Benchstone.BenchI.Fib
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Repro Steps
#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order)) - Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0` - CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0` - AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false` - Dotnet SDK installed for dotnet commands - Running commands from the runtime folder Linux ```cmd # Set $RunDir to the runtime directory RunDir=`pwd` # Set the OS, arch, and OSId RunOS='linux' RunOSId='linux' RunArch='x64' # Create aot directory mkdir -p $RunDir/artifacts/bin/aot/sgen mkdir -p $RunDir/artifacts/bin/aot/pack cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack # Create Core Root $RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release # Clone performance git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance # One line run: python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'Benchstone.BenchI.Fib*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog" # Individual Commands: # Restore dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Build dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Run dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter Benchstone.BenchI.Fib* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200 ``` Windows ```cmd # Set $RunDir to the runtime directory $RunDir="FullPathHere" # Set the OS, arch, and OSId RunOS='windows' RunOSId='win' RunArch='x64' # Create aot directory mkdir $RunDir\artifacts\bin\aot\sgen mkdir $RunDir\artifacts\bin\aot\pack xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y # Create Core Root $RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release # Clone performance git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance # One line run: python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'Benchstone.BenchI.Fib*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog" # Individual Commands: # Restore dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Build dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 # Run dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter Benchstone.BenchI.Fib* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200 ```