search

cskkxjk / MonoNeRD

(ICCV2023) MonoNeRD: NeRF-like Representations for Monocular 3D Object Detection
MIT License
81 stars 3 forks source link

The AP on KITTI val set #4

Open yjy4231 opened 1 year ago

yjy4231 commented 1 year ago

May I ask if the result of your KITTI val set is the result of the last epoch selected? I found that your results on the KITTI val set are much lower than those on the KITTI test set, and when I reproduced them, I found that the highest KITTI AP | 3D from 52 epoch can reach 22.50/17.61/16.94, and from then on, the AP gradually decreases to 18.22/14.17/13.28.

  1. If the result of your KITTI test set is also selecting the last epoch and submitting it to the official benchmark?
cskkxjk commented 1 year ago

1.We evaluate the last 10 epoch ckpts on the KITTI val and report the highest one. It is possible the early epoch model can achieve better performance for not overfitting since KITTI is not a very large dataset. Also the performance gap between epochs (epoch 16-20) become small on Waymo (a larger dataset) based on our evaluation.

  1. We choose 3 ckpts for (random from 51-53, 54-56, 57-60) epochs and submit to the KITTI website and report the best.