KumarRobotics / msckf_vio

Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Other
1.66k stars 592 forks source link

about points in RViz #134

Closed boeun98 closed 2 years ago

boeun98 commented 2 years ago

Hi, I want to know the points in RViz that are made if the msckf_vio launch file is implemented.

my thought:

The points are the extracted features in the camera images.

and the points are used to calculate the length from the camera to the obstacle?

I don't know correctly what the points represent.

And, in my simulation, if the points aren't detected, the frame is filed away.

Please, help me.

Thank you. . . . . . Summary

  1. I want to know the points.

  2. in my simulation, if the points aren't detected, the frame is filed away. What is the problem?

fcladera commented 2 years ago

The points that you are observing is are the extracted features that MSCKF is using. And indeed, if you are not tracking features, you may lose tracking. Unsure about what are the reasons for this, as it may be dependent on your simulation software. We have use MSCKF in simulated environments successfully.

boeun98 commented 2 years ago

Thx for your reply. @fcladera

and I want to ask you something.

Do the point features represent the length between estimated points and the camera image frame?

Why the point features are needed?

fcladera commented 2 years ago

The points are corners that are used to generate features, which then are tracked between frames. This is the classic pipeline for sparse stereo vision.

I recommend understanding some of the basics of CV for stereo vision, as it will help you understand better what this package does. https://www.coursera.org/learn/robotics-perception?specialization=robotics#syllabus