search

nianticlabs / mickey

[CVPR 2024 - Oral] Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences
https://nianticlabs.github.io/mickey/
Other
375 stars 20 forks source link

Run on images from different cameras? #9

Open antithing opened 1 month ago

antithing commented 1 month ago

Hi, can this code be used to calculate the extrinsics between two images from different camera types?

Eg, a DSLR and a GoPro, for example.

Or does it assume the same camera and lens for an image pair?

Thanks!

axelBarroso commented 1 month ago

Hello!

MicKey requires intrinsics during inference time, they are used to lift the 2D points to 3D. If you know the intrinsics of the two images, it should work.

Just a small note, MicKey's training is limited in terms of data. We use the Map-free dataset, which although have many different scenes, all have similar intrinsics. And besides, only smartphone images are in the dataset.

Thanks!