Closed AbdulRehman555 closed 2 months ago
I suggest not using unproject_points for back projection. It is complicated. The function get_rgbd_point_cloud is the friendly interface for backprojecting rgbd data through a camera.
The friendly way to join point cloud data together is join_pointclouds_as_scene.
If you try to roll your own backprojection there are quite a few complications, like accounting for conventions for align_corners and non-square pixels. get_rgbd_point_cloud should match our renderer so there's nothing strange.
unproject_points
is pretty complicated and unclear based on existing documentations.
get_rgbd_point_cloud works pretty good.
I am currently facing a challenge with the process of back-projecting 2D points into 3D world points using the
PerspectiveCameras.unproject_points()
method. The primary goal is to effectively merge these newly obtained 3D world points with an existing set of world points, or alternatively, with the world points derived from another image.To give you a clearer picture of my current setup, here is a snippet of the code I'm working with:
To elaborate, my specific questions and concerns are as follows:
PerspectiveCameras.unproject_points()
?Any guidance, examples, or references to relevant documentation would be immensely helpful in resolving this issue. Thank you in advance for your assistance!