Switch away from asv - Githubissues

scverse / scanpy

Single-cell analysis in Python. Scales to >1M cells.

https://scanpy.readthedocs.io

BSD 3-Clause "New" or "Revised" License

1.82k stars 586 forks source link

Open flying-sheep opened 2 months ago

flying-sheep commented 2 months ago

Additional function parameters / changed functionality / changed defaults?

In https://github.com/scverse/scanpy/pull/3031, I ran into https://github.com/airspeed-velocity/asv/issues/966 which seems to make it almost unusable for our purposes. We need setup to run reliably.

flying-sheep commented 2 months ago

Seems very promising:

Unlimited use from open source repos
Switch from asv to pytest-benchmark / pytest-codspeed
We can use our benchmark machine together with codspeed-runner instead of a GitHub runner

Runner seems to not be supported on Rocky though: https://github.com/CodSpeedHQ/runner/issues/21