codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
76 stars 28 forks source link

Cannot delete submission: submission belongs to an existing competition #1521

Closed MichaelIbrahim-GaTech closed 4 months ago

MichaelIbrahim-GaTech commented 4 months ago

I have used all 15 GB of storage, and whenever I try to delete any previous submission, I get an error "Cannot delete submission: submission belongs to an existing competition", so, I am unable to make any new submissions to any competitions, is there a method to solve this issue, or I just create a new account?

Didayolo commented 4 months ago

Hi @MichaelIbrahim-GaTech,

Indeed, this problem is reported here: https://github.com/codalab/codabench/issues/713

We need to implement a solution. In the meantime, you can share with me your username and submissions you want to remove so I can manually remove them and free some space in your account.

Sorry for the inconvenience.

MichaelIbrahim-GaTech commented 4 months ago

@Didayolo Thanks a lot, my username is: michaelibrahim The submissions, I want to delete are: 50112, 50096, 50070, 49974, 49922, 49900, 49889, 49844, 49822, 49753, 49736, 49709, 49408, 49219, 47922

Didayolo commented 4 months ago

@MichaelIbrahim-GaTech Done. Your quota is now 1.1 GiB / 15.0 GiB.

ihsaan-ullah commented 4 months ago

We cannot allow to delete submissions. Participants can cheat by submitting their submissions and then deleting them later to get more submissions quota (e.g. allowed submissions are 5, someone can delete 3 submissions to upload 3 more, exploiting the quota limit of 5)

MichaelIbrahim-GaTech commented 4 months ago

@Didayolo Thanks

Didayolo commented 4 months ago

We cannot allow to delete submissions. Participants can cheat by submitting their submissions and then deleting them later to get more submissions quota (e.g. allowed submissions are 5, someone can delete 3 submissions to upload 3 more, exploiting the quota limit of 5)

This issue is discussed in #713. See:

Capture d’écran 2024-07-16 à 18 23 25
leiluk1 commented 2 weeks ago

Hello @Didayolo I am experiencing the same issue in the competition that ends in one day. Please help me remove my submissions.

My username is leiluk1. The submissions I want to delete are: 91433, 91441, 91961, 91962, 92402, 92437, 92467, 92493, 92651, 92677, 93397, 93403, 93404, 93406, 93408, 93409

archettialberto commented 2 weeks ago

Hi @Didayolo,

following the discussion on #713, is submission removal after N days an option for participants now? For example, for competitions/benchmarks with a daily (but not global) submission quota it can be extremely useful for users to be able to delete submissions for past days, freeing their quota and keeping up with new ones without admin help.

Thanks for the support!

Didayolo commented 2 weeks ago

@leiluk1 Done

Didayolo commented 2 weeks ago

Hi @archettialberto, unfortunately no, the feature is still not implemented and deployed on production.

giorgionegro commented 1 week ago

Hi, I'm encountering the same issue. However, I’ve noticed that when I sum the sizes of my submission, it doesn't come close to the 15 GB limit; it should be way below that. username: giorgionegro

Didayolo commented 1 week ago

Indeed:

Capture d’écran 2024-11-14 à 11 33 39 Capture d’écran 2024-11-14 à 11 33 42

@OhMaley Any thoughts on this?

OhMaley commented 1 week ago

Submissions, datasets, programs and competition bundles are counted in the quota. What value do you get if you sum up the size of all the files in those categories ?

Also, as a side note, I noticed that the usage is bigger than the quota. It needs to be investigated.

Didayolo commented 1 week ago

@OhMaley There are only submissions in this account