It looks like you are using image_02 and why the R_rect_xx is from 00? Shouldn't you use R_rect_02 instead?
Since you are using sync data, why using apply the R_rect_xx again and shouldn't you instead, as KITTI dev kit suggested, use P_rect_xx to project the camera into the image co-planar? However I didn't see you even parse this matrix.
It looks like you are using
image_02
and why the R_rect_xx is from 00? Shouldn't you use R_rect_02 instead?Since you are using sync data, why using apply the R_rect_xx again and shouldn't you instead, as KITTI dev kit suggested, use P_rect_xx to project the camera into the image co-planar? However I didn't see you even parse this matrix.