search

argoverse / av2-api

Argoverse 2: Next generation datasets for self-driving perception and forecasting.
https://argoverse.github.io/user-guide/
MIT License
307 stars 71 forks source link

Multi-Agent Motion Forecasting: Data inconsistency occurred in EvalAI and dataset downloaded from website #181

Closed ares89 closed 1 year ago

ares89 commented 1 year ago

hi @wqi : When I submitted my results to EvalAI, it returned an error message: KeyError('No predictions found for track 85907 in scenario 0e4e3274-5a8f-41cc-b3da-985a87ed8108.'). However, upon checking the data, it shows that the track category of track 85907 in scenario 0e4e3274-5a8f-41cc-b3da-985a87ed8108 is UNSCORED_TRACK. How can I resolve this issue? Thank you! 图片

ares89 commented 1 year ago

Does this dataset have different versions?

wqi commented 1 year ago

Hi @ares89, the dataset was updated once last year.

Which track are you trying to submit to and how recently did you download the dataset?

ares89 commented 1 year ago

Thank you for your reply. The track I am trying to submit is multi-word forecasting. The dataset was downloaded approximately ten months ago, in August of 2022.

wqi commented 1 year ago

I'd recommend downloading the dataset again from the website - should take care of the issue. :-)

ares89 commented 1 year ago

Re-downloading the test dataset truly solve the problem. thank you! Adding a version code to the dataset would be better.