search

MIT-SPARK / Kimera-VIO

Visual Inertial Odometry with SLAM capabilities and 3D Mesh generation.
BSD 2-Clause "Simplified" License
1.52k stars 415 forks source link

Two stereo cameras #211

Open pooja-kabra opened 1 year ago

pooja-kabra commented 1 year ago

Hi, if my setup has two stereo pairs, what changes should I expect to make in the system to be able to use the extra stereo?

marcusabate commented 9 months ago

We did some work to support multi-camera setups (see here), however this work will not be open-sourced. The changes are not trivial. The fastest way to do it would be to run two frontend modules in parallel, and pass all measurements to the backend. You will have to keep track of which feature tracks are from which frontend, though the final optimization will include all of the data.

I can say that the primary improvement gained from multi-camera setups was in the monocular case, as the scale estimation was improved. However, with stereo we were unable to get much better than with just one stereo camera, since extrinsic calibration was difficult and the error from poor calibration resulted in a lot of outliers in the final factor-graph optimization.