waymo-research / waymo-open-dataset

Waymo Open Dataset
https://www.waymo.com/open
Other
2.73k stars 616 forks source link

Point Cloud and Image do not match #223

Open hchittanuru3 opened 4 years ago

hchittanuru3 commented 4 years ago

Hey! I had a question about the tutorial notebook. So I was using one of the tfrecords from the Waymo Open Dataset, training/segment-6813611334239274394_535_000_555_000.tfrecord to be exact. When I try to project the point cloud on to the image in this case, I get a strange mismatch in the case of the stop sign on the right. I was wondering why this might be the case?

Screen Shot 2020-09-17 at 5 30 45 PM
peisun1115 commented 4 years ago

Did you try to use our pre-computed projection results? If that is not a problem, you can use our projection lib here. https://github.com/waymo-research/waymo-open-dataset/tree/master/third_party/camera/ops

hchittanuru3 commented 4 years ago

No, I was following the notebook, testing with this data. How do we use this library? It's not packaged with waymo_open_dataset.

peisun1115 commented 4 years ago

See my reply in https://github.com/waymo-research/waymo-open-dataset/issues/227 I am also going to release a new version. but you can build the package on your own which should be quite reproducible with the provided docker container