Proteobench / ProteoBench

ProteoBench is an open and collaborative platform for community-curated benchmarks for proteomics data analysis pipelines. Our goal is to allow a continuous, easy, and controlled comparison of proteomics data analysis workflows.
https://proteobench.readthedocs.io
Apache License 2.0
27 stars 7 forks source link

Add warning on good practice in the Module webpage #238

Closed mlocardpaulet closed 4 months ago

mlocardpaulet commented 4 months ago

Discussed in https://github.com/orgs/Proteobench/discussions/237

Originally posted by **mlocardpaulet** February 8, 2024 There is no way to check the data publicly uploaded to ProteoBench. Currently, the only thing that we can do is to save the parameter files associated with the benchmark runs, so that we can reproduce them. This may not be enough... And it has been discussed a lot among us. We need to add a warning in the Module, such as the one in the documentation: ``` This module is not designed to compare later-stages post-processing of quantitative data such as missing value replacement, and we advise users to publically upload data without replacement of missing values and without manual filtering. ``` We also need to discuss with the developers of the tools that we make compatible with ProteoBench to be sure that a maximum of the parameters can be retrieved from their ProteoBench-compatible parameter files.
mlocardpaulet commented 4 months ago

see PR #240

RobbinBouwmeester commented 4 months ago

So this can be closed?