Closed ahar closed 1 year ago
@goldbattle could you please help resolve my queries?
Sorry, have very minimal throughput this time of the year. Here are some initial comments.
I would point you in another direction from briefly looking at your results. You need to calibrate your IMU noises and inflate them a bit (2x for white, and 10x for walks).
For example these should be "in bounds"
And your reprojection error should be much much lower than 5 pixel.
I wouldn't expect any good performance if it is this large....
Hello @goldbattle
Based on your initial response we looked into time-offset
from the recorded bag file shared in my first post. I found that the camera data was reporting at 15Hz
instead of at 30 Hz
. In that, timeoffset
exceeded 20ms (approx. 35Hz
). Upon recording the dataset once more while ensuring the camera frame rate of 30Hz
(reference earlier results), the calibration steps were performed again.
The results obtained for Xsens-630 IMU
+ D415
can be found here (unscaled noise). The same for Lord-CV7 IMU
+ D415
can be found here. Both the IMUs were intrinsically calibrated beforehand using Allan-Variance-Ros
package. Imu.yaml
files for individual IMU containing random-walk
and noise-density
can be found in the abovementioned link respectively.
As you suggested, the extrinsic IMU+camera calibration with scaled-up noise parameters are also performed and can be found in link1 (Xsens-630) and link2 (LORD CV7).
_For Set-1 (Xsens630Imu with D415):_
In the calibration results with scaled-up noise parameters, time-offset
appears to be 8.25ms
. Also, the translation components in imu0 to cam0
Extrinsic transformation matrix has now come down to sub-cm level except for the first element of the translation vector. We expect it to be around 1cm
whereas the calibration result shows approx. 5.2 cm
.
***I would like to know your observations on it (screenshot attached).
With unscaled noise parameters link of the IMUs the optimization failed by printing that matrix is not positive
definite. (screenshot below) :
Queries:
_For Set-2 (Lord-CV7 Imu with D415):_
In this case, the calibration process was completed for both the Scaled and Unscaled Imu.yaml file. But the first element of the translation vector appears incorrect in this case too link Here, the time shift is around 5.4ms
, and it will be good to know your views as to what is the source of the error in this case.
@goldbattle any views on my above query?
The failure is likely due to the noises being too small causing numerical issues, but I am not sure.
Hello,
We have tried to use the Kalibr package to perform extrinsic calibration of a D415 realsense camera and an IMU. A sample dataset is provided with this link. It also contains the calibration result we obtained. Upon carefully looking at the results we realize that the translation components contained within
T_ci
reflects a large distance between the IMU and the camera, which does not match our hardware setup. The error is around ten times the original numbers. Based on these observations and our experience using this package the following are the queries I have and prompt response on the same will help me a lot to understand this software better. Queries:Your help is much appreciated.
p.s. You may need to open your web browser in a private window (incognito) to view the shared files in the above link.
Best,