falconry / falcon

The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
https://falcon.readthedocs.io
Apache License 2.0
9.53k stars 946 forks source link

Evaluate CodSpeed for benchmarking in CI #2238

Open vytas7 opened 4 months ago

vytas7 commented 4 months ago

I talked to @adriencaccia from CodSpeed during EuroPython 2024, and it turns out that they productified the same Gist by @itamarst that https://github.com/falconry/falcon/pull/1825 is based upon :smiling_imp:

CodSpeed is free for open source projects, and it has even by adopted by projects like Ruff.

itamarst commented 4 months ago

I've set up codspeed for Twisted, it's quite nice (and has already caught some regressions, and enabled some optimizations). Recommend lowering the thresholds for what it considers a change, once you have some data.