search

Proteobench / ProteoBench

ProteoBench is an open and collaborative platform for community-curated benchmarks for proteomics data analysis pipelines. Our goal is to allow a continuous, easy, and controlled comparison of proteomics data analysis workflows.
https://proteobench.readthedocs.io
Apache License 2.0
27 stars 7 forks source link

keep track of ProteoBench version in the parsed parameters of the runs? #309

Open mlocardpaulet opened 1 month ago

mlocardpaulet commented 1 month ago

This is a suggestion. Since we keep uploading files to the module while developing, it would be good to keep track of Proteobench version in the parameters of the runs. This way, when there is a change that can affect the outputs, we can re-run only the subset of output runs that was affected, what do you think?

enryH commented 1 month ago

That is definitely an option which is easy to realize. To make this even more meaningful

  1. I would switch to identify a version which is in-between releases (using https://setuptools-scm.readthedocs.io/ )
  2. Re-running all calculations should be not too expensive. Even if a batch job runs a couple of hours this is good for our setup.