It would be incredibly beneficial to add some 2D to 3D projection of objects in the camera frame. We can assume the following information available a priori:
end effector pose
camera pose
extrinsic and intrinsic camera calibration parameters
some information about the size of the object we would like to track in 3D
It would be incredibly beneficial to add some 2D to 3D projection of objects in the camera frame. We can assume the following information available a priori: