I'm trying to project a 3d gaze on the egocentric image plane, however found that the provided code example can only use the built-in function get_gaze_vector_reprojection to project the pixel location on a 90-deg-rotated rgb image. Such a setting is quite constricted (two different sets of 2880x2880 or 1408x1408 calibration params are sealed in vrs/noimagestreams vrs) which is quite hard to fatch. I want to project a predicted 3d-gaze ray (composed by 2 (x,y,z) numbers) to a down-sampled 448x448 rgb frame. Since the fisheye camera doesn't have a linear conversion between pixel scales on different resolutions, I didn't find a direct solution to do this, can you share the script/pointers as an alternative to the built-in function? Thank you.
Hi, thank you for the great project!
I'm trying to project a 3d gaze on the egocentric image plane, however found that the provided code example can only use the built-in function
get_gaze_vector_reprojectionto project the pixel location on a 90-deg-rotated rgb image. Such a setting is quite constricted (two different sets of 2880x2880 or 1408x1408 calibration params are sealed in vrs/noimagestreams vrs) which is quite hard to fatch. I want to project a predicted 3d-gaze ray (composed by 2 (x,y,z) numbers) to a down-sampled 448x448 rgb frame. Since the fisheye camera doesn't have a linear conversion between pixel scales on different resolutions, I didn't find a direct solution to do this, can you share the script/pointers as an alternative to the built-in function? Thank you.