They fluctuate a bit, except during August - mid-November 2023. I wonder what happened then to make the results so stable, and whether that situation can be recreated.
@ajkr The Continuous Benchmarking has now been re-enabled after we just migrated it from CircleCI to GitHub Actions. Could you take a look at provide us with any updates/feedback please (cc @rhubner @alanpaxton)
Expected behavior
The performance regression results have low noise
Actual behavior
They fluctuate a bit, except during August - mid-November 2023. I wonder what happened then to make the results so stable, and whether that situation can be recreated.
Steps to reproduce the behavior
The dashboard is here - https://search-rocksdb-bench-k2izhptfeap2hjfxteolsgsynm.us-west-2.es.amazonaws.com/_dashboards/app/dashboards#/view/9efe4fc0-fdd9-11ec-9f1d-b7bf4fe8d037. AFAIK it isn't publicly available, but here's a sample -