django / django-asv

Benchmarks for Django using asv
MIT License
40 stars 12 forks source link

Repeatable benchmarks #50

Open smithdc1 opened 2 years ago

smithdc1 commented 2 years ago

https://smithdc1.github.io/django-asv/#template_benchmarks.template_compilation.benchmark.TemplateCompile.time_template_compile

So we are starting to build up some history now each day which is great.

This chart shows two things.

The long tail history which was run on a single server. This had repeatable results

The more recent daily commits are run on different machines and are much more noisy.

@deepakdinesh1123 and views on making this more repeatable?

@carltongibson any news from the ops team?