search

facebookresearch / habitat-challenge

Code for the habitat challenge
https://aihabitat.org
MIT License
303 stars 57 forks source link

Submitting to 2021 MP3D ObjNav #134

Closed ajzhai closed 1 year ago

ajzhai commented 1 year ago

I would like to see my ObjNav agent's performance on the 2021 MP3D test-standard set for comparison with some older methods. However, none of my submissions to EvalAI are returning. Even on Minival, they have been on "Running" status for 72 hours. Is this due to a long queue, or are those servers no longer supported?

ykarmesh commented 1 year ago

Hey @ajzhai , we are investigating the reason for it. We will try to get back to you soon!

ajzhai commented 1 year ago

Looks like some of them finally returned recently. I guess the queue is just getting overloaded then?

ykarmesh commented 1 year ago

Yes, that is what we also found out on our end. Closing this issue for now!

ajzhai commented 1 year ago

Hey @ykarmesh, my previous submissions gave error messages in the stderr when they failed, but my last one ran for a long time and failed with no error message at all. Do you know what the problem might be? My team name is Finding NIMO.