carla-simulator / leaderboard

CARLA Autonomous Driving leaderboard
MIT License
164 stars 77 forks source link

Can not push leaderboard test docker to EvalAI platform #164

Open rb93dett opened 8 months ago

rb93dett commented 8 months ago

Hi, I‘m trying to test my CARLA agent on the CARLA leaderboard 1.0 (CARLA Autonomous Driving Challenge 2.0), for which I have obtained permission from the organizers to compete. I have installed the latest version of the EvalAI package (1.3.16) and successfully completed the "set token" operation.

However, when attempting to use the "evalai push" command to submit the required Docker image to the leaderboard, I encountered an error message "Error: None". Additionally, I tried other commands such as "evalai challenges," but received a "401 Client Error: Unauthorized for url: https://eval.ai/api/challenges/challenge/all" error.

I have attempted these operations on both a Linux machine and my personal Mac, and encountered the same issues on both platforms. Upon searching the EvalAI forum, I discovered that other users have also encountered similar problems, which can find here: https://evalai-forum.cloudcv.org/t/evalai-push-error-or-am-i-just-a-noob-with-docker/1773

I tried to send an email to the EvalAI team but got no response, so I wonder if you could give me any advice, I would be very appreciate!

My commands for push the docker to the platform:

pip install evalai evalai set_token {MY_EVALAI_TOKEN} evalai push {MY_DOCKER_IMAGE} --phase carla-leaderboard-10-sensors-2098