Very big difference when between eval and test scores using Reference Model.ipynb

lyft / nuscenes-devkit

Devkit for the public 2019 Lyft Level 5 AV Dataset (fork of https://github.com/nutonomy/nuscenes-devkit)

Other

365 stars 103 forks source link

Very big difference when between eval and test scores using Reference Model.ipynb #55

Closed yangz0626 closed 4 years ago

yangz0626 commented 4 years ago

I tried to use the model and trained parameters in Reference Model.ipynb to generate a test csv file to submit to kaggle. However while eval score is 0.104 using official api , the test score in the website is only 0.005. Is that right or somewhere wrong when I generating csv file? What's your test score if using Reference Model.ipynb? Thanks!