rpng / MINS

An efficient and robust multisensor-aided inertial navigation system with online calibration that is capable of fusing IMU, camera, LiDAR, GPS/GNSS, and wheel sensors. Use cases: VINS/VIO, GPS-INS, LINS/LIO, multi-sensor fusion for localization and mapping (SLAM). This repository also provides multi-sensor simulation and data.
GNU General Public License v3.0
427 stars 74 forks source link

Lidar Undistortion #1

Closed lnexenl closed 11 months ago

lnexenl commented 11 months ago

Hi, I currently run MINS on some private datasets, where a car goes around the figure eight, requiring a high-precision lidar undistortion function.

However, I find that lidar undistortion function requires v_angles and h_angles to undistort point cloud. And this function also assumes that the time differences between each point are same. success = state->get_interpolated_pose(lidar_inL->time + dt - (total - i) * op->raw_point_dt, RGtoIi, pIiinG);

I think lidar undistortion function could be made more general, by getting each point's timestamp directly from ros msg. Is it possible to introduce this as a new feature in your future work?

WoosikLee2510 commented 11 months ago

Hi, thanks for having interest in this project and providing your thoughts.

The code is written pretty easily to be modified for your application. You need to pass the point's timestamp you get from the message to this function and replace the lidar time input with it (add 'dt' if lidar timeoffset is non-zero).

I assume you are using Livox kind of LiDAR sensors which provide each point's timestamp. I didn't implement the function in the way you suggested because most other widely used sensors, such as Velodyne or Ouster LiDARs do not provide such detailed information. I will put this on my todo list.

lnexenl commented 11 months ago

Yes, the dataset includes some solid-state lidars. May be I will do some work on this submit a pull request later.

WoosikLee2510 commented 11 months ago

Sure, your contribution will be welcomed. Please reopen the issue if you need any other thing to discuss.

mahammadirfan commented 5 months ago

@lnexenl hey have you tried MINS with any livox lidar ?

lnexenl commented 5 months ago

@lnexenl hey have you tried MINS with any livox lidar ?

I haven't tried livox lidar, I worked on robosense and seyond lidars. These lidars produce pointclouds with timestamp on each point. But the undistortion method currently used in MINS doesn't suit these lidars very well. And I finally use MINS as a multi-cam/INS/Wheel odometry.