Are 360 annotations used in CAMERA_ALL evaluation?

waymo-research / waymo-open-dataset

Waymo Open Dataset

https://www.waymo.com/open

Other

2.68k stars 610 forks source link

Are 360 annotations used in CAMERA_ALL evaluation? #329

Open nhatnxm opened 3 years ago

nhatnxm commented 3 years ago

If modality is CAMERA ONLY, model cann't perceive objects in 360 view, especially the back behind the car. I wonder if 360 annotations are used to evaluate model trained by CAMERA ONLY or, do you only use annotations that are in the field of view of cameras?

peisun1115 commented 3 years ago

yes, 360 annotations are used. those annotations that are not visible in cameras are considered FNs which is true for all CAMERA_ALL models. So the metrics should still be valid.