search

DrewScoggins / performance-2

This repo contains benchmarks used for testing the performance of all .NET Runtimes
MIT License
0 stars 0 forks source link

[Perf] Changes at 11/23/2020 9:51:34 PM #3540

Open performanceautofiler[bot] opened 3 years ago

performanceautofiler[bot] commented 3 years ago

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 72185771e8dfd87d5a45732aec1566d8f3147c6e
Compare 3f8966546a09ec104ca958eab20a22463907fed1

Improvemnts in LinqBenchmarks

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Count00ForX](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/master_arm64_ubuntu 18.04/LinqBenchmarks.Count00ForX.html>) 1.48 secs 497.05 ms 0.34
[Where01ForX](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/master_arm64_ubuntu 18.04/LinqBenchmarks.Where01ForX.html>) 626.25 ms 378.15 ms 0.60
[Where00ForX](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/master_arm64_ubuntu 18.04/LinqBenchmarks.Where00ForX.html>) 1.80 secs 748.63 ms 0.42

graph graph graph Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'LinqBenchmarks*'
. ### Payloads [Baseline]() [Compare]() ### Histogram #### LinqBenchmarks.Count00ForX ```log [ 111181669.558 ; 334893353.975) | @@@@@@@@@@@@@@@@@@@@@@@@ [ 334893353.975 ; 479627796.692) | [ 479627796.692 ; 688096765.975) | @@@@@@@@@@@@@@@@@@@@@@ [ 688096765.975 ; 896565735.258) | [ 896565735.258 ; 1105034704.542) | [1105034704.542 ; 1375155478.833) | [1375155478.833 ; 1584084654.257) | @@ ``` #### LinqBenchmarks.Where01ForX ```log [356429754.558 ; 412888970.042) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ [412888970.042 ; 469348185.526) | [469348185.526 ; 510101555.391) | [510101555.391 ; 566560770.875) | @@@@@@@@@@@ [566560770.875 ; 601361043.958) | [601361043.958 ; 661165673.275) | @@ ``` #### LinqBenchmarks.Where00ForX ```log [ 406131972.418 ; 638777425.048) | @@@@@@@@@@@@@@@@@@@@@@@@ [ 638777425.048 ; 888960691.983) | @@@@@@@@@@ [ 888960691.983 ; 1106761451.546) | @@@@@@@@@@@ [1106761451.546 ; 1324562211.109) | [1324562211.109 ; 1542362970.673) | [1542362970.673 ; 1696596021.952) | [1696596021.952 ; 1916478494.982) | @@ ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline 72185771e8dfd87d5a45732aec1566d8f3147c6e
Compare 3f8966546a09ec104ca958eab20a22463907fed1

Improvemnts in System.Linq.Tests.Perf_OrderBy

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[OrderByCustomComparer](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/master_arm64_ubuntu 18.04/System.Linq.Tests.Perf_OrderBy.OrderByCustomComparer(NumberOfPeople%3a%20512).html>) 247.80 μs 178.05 μs 0.72

graph Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Linq.Tests.Perf_OrderBy*'
. ### Payloads [Baseline]() [Compare]() ### Histogram #### System.Linq.Tests.Perf_OrderBy.OrderByCustomComparer(NumberOfPeople: 512) ```log [174868.902 ; 197349.807) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ [197349.807 ; 219830.712) | [219830.712 ; 241961.383) | [241961.383 ; 264442.289) | @@@@@@@@@@@@@ ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
adamsitnik commented 3 years ago

Looks like an actual improvement, most probably caused by https://github.com/dotnet/runtime/pull/44790