acfr / cam_lidar_calibration

(ITSC 2021) Optimising the selection of samples for robust lidar camera calibration. This package estimates the calibration parameters from camera to lidar frame.
Apache License 2.0
436 stars 102 forks source link

Reprojection Image Seems Strange #44

Closed monamourvert closed 10 months ago

monamourvert commented 1 year ago

Hi, I applied your code to my own data an strangely I got this result. I worked with your noetic branch with Azure Kinect Camera and Ouster Lidar.

My reprojection result: image

Since I'm new at this, I just wondering is this kind of result is normal? I tried several times, and most of them produce similar result. The only different is the place of the yellow and the green cross sometimes not lies on the center of board. Is there anyone also experience this strange result?

monamourvert commented 1 year ago

Another thing that I found, no matter perfectly I isolate the chessboard, the dimension error is quite large. So, to summarize it:

  1. I calculate the offset of the chessboard as accurate as I can for the params.yaml
  2. The camera_info is directly retrieved from /rgb/camera_info from Azure Kinect so I assume there is nothing wrong with the intrinsic parameter.
  3. I tried to isolate the chessboard as detail as I can. This one is just an example (I screenshot this as fast as I can) image image But I guess the dot that mark the board area seems having a big translation from the edge. I don't know, I'm not so sure.
  4. The dimension error of the board is strangely always > 40 image

Hope somebody can help me about this. Thanks!

chinitaberrio commented 10 months ago

@monamourvert, which lidar are you using? is the camera calibrated?