lyft / nuscenes-devkit

Devkit for the public 2019 Lyft Level 5 AV Dataset (fork of https://github.com/nutonomy/nuscenes-devkit)
Other
366 stars 103 forks source link

No train/val split in the Kaggle competition? #26

Closed Tai-Wang closed 4 years ago

Tai-Wang commented 4 years ago

Hi,

I think there could have been validation set for this dataset (see https://level5.lyft.com/dataset/download-dataset/), but I don't find it in the Kaggle competition. So I'd like to know is there any train/val split like nuscenes?

Actually I think it will be more convenient and fair to do ablation studies if there is a given train/val split. :) (Or I may need to submit results on the test set again and again to have the system evaluate them...)

ternaus commented 4 years ago

At Kaggle:

Public Leaderboard - validation. Private Leaderboard - test.