codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
65 stars 26 forks source link

Submitted files are included in output from prediction step #1438

Open ihsaan-ullah opened 4 months ago

ihsaan-ullah commented 4 months ago

Ingestion result

When you download prediction result from codabench, it also contains submission files and metadata file

Scoring result

Scoring result has additional metadata file in the directory

Didayolo commented 4 months ago

I do not get what you mean. Is there an actual problem, or something we want to change here?

ihsaan-ullah commented 4 months ago

Just wanted to check why the files are repeated. Maybe we can save some space by not repeating the files

Didayolo commented 4 months ago

Isn't it a different metadata file? I am trying to download the results and I can't find what's problematic.

ihsaan-ullah commented 4 months ago

In the ingestion result

Screenshot 2024-05-13 at 5 54 37 PM

the submission files are also included. If the submission file is big, it is a waste of space.

You are right the meta data file is different