search

facebookresearch / habitat-challenge

Code for the habitat challenge
https://aihabitat.org
MIT License
307 stars 56 forks source link

Eval.ai submission is not evaluating #175

Open alstar8 opened 1 year ago

alstar8 commented 1 year ago

Hi! I have submitted a docker with my solution at Eval.ai platform and it immediatly got status 'Submitted'. But since then it last four days and the status remains the same and the platform still have not gave me the result. Is that normal or what is the time I need to wait to submission get evaluated? The deadline for the challenge is close and it would be nice to see any evaluated submissions before uploading to the challenge phase.

gchhablani commented 1 year ago

@alstar8 Thanks for reaching out! We have resolved the issue. The submissions should start evaluating. Please let us know in case of any issues.

alstar8 commented 1 year ago

@gchhablani

Today we faced the fact that the challenge website said that submissions could be done up to May 31, but Eval AI only allowed submissions until May 30, and there were limitations on how many simultaneous submissions could be uploaded (only one, and a single submit was evaluating for more than two days). Could you please update the EvalAI platform to allow us to use all the challenge attempts within the claimed dates?