wrong deadline setting on hosts of challenge 2023!!!

[KarelZhang]

From the evalai page (blow), the submission deadline of challenge phase is May 31, 2023 12:59:59 PM CST, which means the deadline is May 31, 2023 1 PM CST.

However, when I submited my final submission to challeng phase at 8:24 AM CST on May 31, the hosts refused my submission. I think the hosts' deadline is set wrong (earlier than posted on evalai page). And I hope you can help me to submit my final submission to challenge phase.

Until now, my last submission can only submit to the test phase but without anything else to do. The submission time is around May 31, 2023 8:24 AM CST.

[alstar8]

We also encountered the fact that the platform did not check submissions for a long time (a single minival was evaluated from May 20 to May 24), and on May 31 EvalAI stopped allowing submissions. We would also like to be able to submit the remaining attempts with no limits on the simultaneous submissions.

[KarelZhang]

We also encountered the fact that the platform did not check submissions for a long time (a single minival was evaluated from May 20 to May 24), and on May 31 EvalAI stopped allowing submissions. We would also like to be able to submit the remaining attempts with no limits on the simultaneous submissions.

Yes, the deadline claimed on platform is different from the platform servers, which misleading me about when to submit the final docker image to challenge phase.

[gchhablani]

@alstar8 @KarelZhang Can you please provide screenshots of what time you see? As well as your location if possible. I checked the CST timezone and I see deadline as 30th May 11:59 PM.

[alstar8]

@gchhablani For me, the deadline happened on 31st May at 8:00 AM (as it writes on the website I thought it would be the end of 31st May, not the 30th). But the biggest misunderstanding for me is the rule that I can submit only one submission at a time and the evaluation time was not declared and for our team was over 4 days even for the Minival phase (that contains only 30 episodes). And I could not even cancel the last challenge phase submission (that still evaluating after three days) to submit the new one within the deadline time.

[KarelZhang]

@gchhablani I am in China

[gchhablani]

@KarelZhang @alstar8

The time shown on EvalAI is correct. We show the time on EvalAI in the participant's timezone.

CST is not central time, but China Standard Time for your case @KarelZhang. Therefore, I believe there must have been a confusion at your end about this.

[gchhablani]

@alstar8 Evaluation time cannot be declared beforehand as each evaluation takes a different time. All your pending submissions will be evaluated. Towards the end of the deadline, there were many submissions, because of which the queue was overloaded. You can send us contact message on EvalAI to cancel submissions in case you are not able to do so.

[KarelZhang]

@gchhablani Evalai's website is in the United States, and you organizers are also in the United States. So my first reaction must be Central Time in the United States. This is the case for other academic conferences, which are calculated according to the standard time of the venue. I think the reason of this issue is the organizers didn't explain clearly, and this issue should be resolved. The best solution is let us complete the final submission.

[gchhablani]

@alstar8 @KarelZhang The deadline has been extended to June 5, 2023 11:59:59 PM EST. Hope that will help.

[KarelZhang]

@gchhablani That‘ s great !!!!!!