Open zyandtom opened 1 month ago
Hi @zyandtom, thanks for your interest in MapBench! MapBench is constructed by corrupting the val set of nuScenes. We chose nuScenes since it has been widely utilized among almost all recent HD map construction works.
On which dataset did you conduct the evaluation? Acoording to https://arxiv.org/abs/2312.06420, the train, test and eval scenarios of Nuscenes/Argoverse dataset have geographical overlap which may cause data leakage.