search

DrewScoggins / performance-2

This repo contains benchmarks used for testing the performance of all .NET Runtimes
MIT License
0 stars 0 forks source link

[Perf] Changes at 11/27/2020 3:07:06 AM #3537

Open performanceautofiler[bot] opened 3 years ago

performanceautofiler[bot] commented 3 years ago

Run Information

Architecture arm64
OS ubuntu 18.04
Baseline bf1b48d04cfbe299a4dd253d2f2cb74881428447
Compare 7171407822a9a94b6ac12aca652851e74f3b604d

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ToString](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/master_arm64_ubuntu 18.04/System.Tests.Perf_Single.ToString(value%3a%2012345).html>) 292.72 ns 362.96 ns 1.24

graph Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Tests.Perf_Single*'
. ### Payloads [Baseline]() [Compare]() ### Histogram #### System.Tests.Perf_Single.ToString(value: 12345) ```log [288.389 ; 301.271) | @@@@@@@@@ [301.271 ; 314.051) | @@@@@@@@@@@@@@@@@@@ [314.051 ; 325.821) | @@@@@ [325.821 ; 338.601) | @@@@@@@@@@@@@ [338.601 ; 353.533) | [353.533 ; 366.312) | @@@ ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
adamsitnik commented 3 years ago

@DrewScoggins the historical data that leads to "all data" link shows only last week.

adamsitnik commented 3 years ago

Based on the available data we don't know if it's a regression or noise

DrewScoggins commented 3 years ago

@DrewScoggins the historical data that leads to "all data" link shows only last week.

That is because we only have one weeks worth of data for this trend.