introlab / rtabmap

RTAB-Map library and standalone application
https://introlab.github.io/rtabmap
Other
2.83k stars 787 forks source link

[Feature Request] Add XFeat Learned Keypoint Detector & Descriptor #1371

Open tak2hu opened 3 weeks ago

tak2hu commented 3 weeks ago

XFeat: Accelerated Features for Lightweight Image Matching TL;DR: Really fast learned keypoint detector and descriptor. Supports sparse and semi-dense matching.

Deep learning based feature detectors are usually more robust but are heavy using CPU. I got 1 FPS using the SuperPoint demo but 5 FPS with the XFeat demo (not much ik but still) using an Intel Core i7 Gen 8 laptop. It's a nice alternative to SuperPoint and I'm curious how well it would integrate into RTAB-Map.

Also with LightGlue learned matcher would be nice too.

matlabbe commented 3 weeks ago

With right python interface, they could be probably be used in rtabmap without changing c++ code. See examples: https://github.com/introlab/rtabmap/tree/master/corelib/src/python

Related posts: