real-stanford / universal_manipulation_interface

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots
https://umi-gripper.github.io/
MIT License
706 stars 138 forks source link

Regarding the inaccurate spatial positioning of ArUco markers after calibrating the GoPro 9. #61

Open WanCai-ac opened 2 months ago

WanCai-ac commented 2 months ago

Great job! I have a few small questions. I'm using a GoPro 9 with a Maxlen fisheye lens, set to 60fps and 2.7K (4:3). The lens is wide. I've also used OPENICC for camera calibration, but no matter what I do, the z-axis of the ArUco markers is only 1 cm. The two x coordinates on the claw should be one positive and one negative, but both are positive. the camer calibration parameter: { "final_reproj_error": 0.32035882968818824, "fps": 59.94005994005994, "image_height": 2028, "image_width": 2704, "intrinsic_type": "FISHEYE", "intrinsics": { "aspect_ratio": 1.00635762816638, "focal_length": 327.56883200404826, "principal_pt_x": 681.2039062485959, "principal_pt_y": 508.51180510387644, "radial_distortion_1": 0.11756393590350642, "radial_distortion_2": 0.023354806960332323, "radial_distortion_3": -0.03610319430954094, "radial_distortion_4": 0.006486720806227832, "skew": 0.0 }, "nr_calib_images": 89, "stabelized": false } right aruco pose[[[0.19976677 0.1763837 0.01706142]]] left aruco pose[[[0.0255818 0.14481249 0.01418246]]]