huangwl18 / ReKep

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
https://rekep-robot.github.io/
532 stars 54 forks source link

About oguntils.py——def pixel_to_3d_points(depth_image, intrinsics, extrinsics) question #2

Open haochen611 opened 2 months ago

haochen611 commented 2 months ago

Dear author, hello, thanks for your work on ReKep。 I have some question about the funtion of “pixel_to_3d_points”。There is no hand-eye calibration conversion matrix in this function, I guess you think that the base of the robot arm is the world coordinate system in the simulation, and then directly convert the coordinates under the camera coordinate system into the coordinates of the coordinate system of the robot arm base in the simulation 。 I kindly ask for your help in answering, and please forgive me if you are disturbed.