search

mapbench / toolkit

Is Your HD Map Constructor Reliable under Sensor Corruptions?
https://mapbench.github.io
Apache License 2.0
33 stars 1 forks source link

About dataset overlap #3

Open zyandtom opened 1 month ago

zyandtom commented 1 month ago

On which dataset did you conduct the evaluation? Acoording to https://arxiv.org/abs/2312.06420, the train, test and eval scenarios of Nuscenes/Argoverse dataset have geographical overlap which may cause data leakage.

mapbench commented 1 month ago

Hi @zyandtom, thanks for your interest in MapBench! MapBench is constructed by corrupting the val set of nuScenes. We chose nuScenes since it has been widely utilized among almost all recent HD map construction works.