search

codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
76 stars 28 forks source link

Solution Stuck on "Submitted" #1507

Open JasonMendoza2008 opened 4 months ago

JasonMendoza2008 commented 4 months ago

Submission stuck on Submitted. It happens randomly. I had to cancel last time after several hours but it counted towards my quota. What can I do:

image

My username is jmendoza2008 on Codabench

ihsaan-ullah commented 4 months ago

Your submission is not cancelled, its status is submitted. Only cancelled and failed submissions are not counted in the quota.

JasonMendoza2008 commented 4 months ago

@ihsaan-ullah I know I'm saying last time I had to cancel (this is what I meant in my initial message by "I had to cancel last time after several hours") and this time it's just stuck so I'm worrying I might have to cancel it too.

JasonMendoza2008 commented 4 months ago

@ihsaan-ullah Cancelled submissions are counted in the quota.

ihsaan-ullah commented 4 months ago

@ihsaan-ullah Cancelled submissions are counted in the quota.

my mistake, cancelled are indeed counted in the quota

ihsaan-ullah commented 4 months ago

Not sure why your submission is stuck in submitted. I reran your submission. It seems to be working now

JasonMendoza2008 commented 4 months ago

Yes I saw. Thank you very much for your help.

JasonMendoza2008 commented 4 months ago

I'm sorry @ihsaan-ullah, but my submission is again stuck:

image

I hope I'm not doing something wrong? Here is the content of my submission in case that's useful to you: my_submission.zip

JasonMendoza2008 commented 4 months ago

Would love to know if I can submit other submissions (it's still stuck 48 hours later and I don't want to break anything on codabench by submitting before this submission is dealt with) EDIT: My bad I should've just cancelled it EDIT2: Well I re-submitted it and it's still stuck ...

Didayolo commented 4 months ago

Hi,

The problem you are encountering was fixed here: #1503

We still need to deploy this change. It should be done later today.

Didayolo commented 4 months ago

Deployed! Feel free to re-open the issue if you encounter it again.

JasonMendoza2008 commented 4 months ago

@Didayolo you might want to close https://github.com/codalab/codabench/issues/1509 too

JasonMendoza2008 commented 4 months ago

The issue is not resolved @Didayolo

image

(Stuck for 24 hours)

PS: I cannot reopen the issue since you closed it.

Didayolo commented 4 months ago

Hi @JasonMendoza2008,

Can you please share the URL of the competition and your username?

JasonMendoza2008 commented 4 months ago

@Didayolo https://www.codabench.org/competitions/3188 and jmendoza2008

Didayolo commented 4 months ago

OK so this competition is using the public queue, not a private queue. The problem may be related to:

I see that some submissions after this one did succeed.

JasonMendoza2008 commented 4 months ago

Yes, it randomly fails and I have to re-submit.

sourabhd13 commented 3 months ago

We are also facing a similar issue. Multiple submissions are stuck at various stages (Scoring, Submitting) for a long time. My username is sourabhd.

Didayolo commented 1 month ago

Any update on this?