data-apis / scipy-2023-presentation

Materials for the SciPy 2023 Data APIs Consortium presentation and proceedings paper
MIT License
3 stars 11 forks source link

Add lockfile for benchmarks #24

Closed kgryte closed 1 year ago

kgryte commented 1 year ago

We should ensure that we include a lockfile for the benchmarks in this repository in order to ensure reproducibility of results.

asmeurer commented 1 year ago

What's the best format to use for this? Note that scikit-learn and scipy were both tested against a specific git commit hash (scipy against an unmerged PR, scikit-learn against an unreleased commit from their main branch).

kgryte commented 1 year ago

A requirements.txt using specific Git hashes? See SO.