Parskatt / RoMa

[CVPR 2024] RoMa: Robust Dense Feature Matching; RoMa is the robust dense feature matcher capable of estimating pixel-dense warps and reliable certainties for almost any image pair.
https://parskatt.github.io/RoMa/
MIT License
629 stars 51 forks source link

Tiny Dino performance? #77

Open skill-diver opened 2 months ago

skill-diver commented 2 months ago

Hi Author,

Thanks for sharing. Have you ever tried the performance of using tiny dino in the encoder part?

Parskatt commented 3 weeks ago

Is there a tiny DINOv2? I know there is a ViT-S. The performance for the smaller versions typically degrade the performance, but not to badly. The main issue is that most compute is spent on the refinement for high resolution inputs so benefit of smaller backbone goes away.