search

waymo-research / waymo-open-dataset

Waymo Open Dataset
https://www.waymo.com/open
Other
2.74k stars 622 forks source link

3d tracking benchmark #202

Open bilalsattar opened 4 years ago

bilalsattar commented 4 years ago

Hi,

I am working on 3d tracking by using only camera images (no lidar). So it restricts the 360 degree space to only visible by camera. Your online benchmarks have an option 'C: All cameras'. Is this option compares predicted tracks with camera visible ground truth tracks or with all ground truths(360 degree)?

peisun1115 commented 4 years ago

we compare with 360 degree. But we can update the metrics if there is a need. We have not seen any submission using that

bilalsattar commented 4 years ago

It's better if you provide this benchmark. Because it's most logical when using only cameras for 3d tracking.

bilalsattar commented 4 years ago

Also, it's better, if you update baseline detections for Tracking task with top-performing 3D detections from the leaderboard.

bilalsattar commented 4 years ago

@peisun1115 a reminder! can you please provide benchmark for 3d tracking in only cameras scope. It would be helpful for sensor fusion problem