Issue with updating scoring program, most probably zip compression issue. - Githubissues

codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0

Apache License 2.0

76 stars 28 forks source link

Issue with updating scoring program, most probably zip compression issue. #1514

Closed aprbw closed 4 months ago

aprbw commented 4 months ago

I'm developing a competition https://www.codabench.org/competitions/3347

My issue is about updating the scoring.py.

What works:

https://www.codabench.org/tasks/, Dataset and programs tab, select a scoring program
Download the zip file
upload the ! same ! zipfile in Add Dataset/Program
Tasks tab, update the task, Dataset and programs tab, select a scoring program
Submit a file as a competitor.

What does NOT work:

https://www.codabench.org/tasks/, Dataset and programs tab, select a scoring program
Download the zip file
!!! Unzip
!!! Zip again (using MacOS Sonoma 14.5 secondary click and then Compress...)
!!! upload the re-zipped zipfile in Add Dataset/Program
Tasks tab, update the task, Dataset and programs tab, select a scoring program
Submit a file as a competitor.
! Either stuck on submitted, or failed. the logs are empty.

Side note, what also works:

https://www.codabench.org/competitions/
Upload a custom bundle that I zip locally using the same macos functionality.

Please advise, thanks.

aprbw commented 4 months ago

Solution: Instead of zipping the folder, I have to zip the content of the folder.