val-iisc / 3d-lmnet

Repository for 3D-LMNet: Latent Embedding Matching for Accurate and Diverse 3D Point Cloud Reconstruction from a Single Image [BMVC 2018]
https://val-iisc.github.io/3d-lmnet/
MIT License
113 stars 24 forks source link

The frame the point cloud lies in #10

Closed ptrnn closed 3 years ago

ptrnn commented 3 years ago

Hello, thank you for your excellent work. I have a question about the dataset preparation. Say if we have access to the depth image and camera parameters (intrinsic and extrinsic), we backproject depth image to 3d space using intrinsic matrix and transform it from camera frame to world frame using extrinsic matrix. Do sampled ground truth point cloud and point cloud recovered from depth lie in the same frame? Or the ground truth pc lies in their own body frame?

priyankamandikal commented 3 years ago

Hi, it shouldn't be a problem if you use depth maps to obtain the point cloud in the world frame. Note that, we use the point cloud in a canonical frame without rotation, so you would have to factor out the camera rotation if you want to use canonical orientations like we do.

ptrnn commented 3 years ago

Hi Priyanka, thank you for your reply. Just to clarify, your work use the same ground truth for one object captured from different viewpoints while PSGN used different ground truths for that, right?

mayankgrwl97 commented 3 years ago

That's correct.