search

qianqianwang68 / caps

MIT License
183 stars 25 forks source link

The feasibility of outputs keypoint and descriptor #9

Open aruba01 opened 2 years ago

aruba01 commented 2 years ago

I am doing some work on visual localization. I think that this task needs tailored keypoint and descriptor and CAPS can be seen as tailored. As Superpoint output keypoint and descriptor simultaneously, can the future work of CAPS do the same thing?

qianqianwang68 commented 2 years ago

Yes, for sure. Jointly learning keypoint and descriptors would be a great idea. DISK has shown that the epipolar constraints can be used to learn keypoints as effectively as using strong supervision of depths. We haven't explored the joint keypoint and descriptor training, but it would be an interesting and important future direction.