Predicting X and Y coordinates directly.

nianticlabs / mickey

[CVPR 2024 - Oral] Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences

https://nianticlabs.github.io/mickey/

Other

501 stars 31 forks source link

Predicting X and Y coordinates directly. #14

Closed JayKarhade closed 4 months ago

JayKarhade commented 4 months ago

Hi,

Really exciting work!

I had a quick question - did you consider directly predicting the X and Y coordinates in 3D instead of the offsets and using the intrinsics to project them?

axelBarroso commented 4 months ago

Hello! We did not try that, but it sounds very interesting! I see that option closer to what DUSt3R/MASt3R does, so I would be keen to learn how that variant works. Thanks for the interest!

JayKarhade commented 4 months ago

Thanks! I'll let you know how the training goes :)