naver / mast3r

Grounding Image Matching in 3D with MASt3R
Other
1.27k stars 95 forks source link

Disallow matches on background (black points) #38

Open estaudere opened 2 months ago

estaudere commented 2 months ago

I want to force mast3r to ignore all background pixels when creating the point cloud (essentially, to disallow keypoint matches on the black pixels). I've tried filtering out black points during point cloud post-processing, but this leaves a bit of noise around the main object because those points are no longer true black, and I don't want to rely on this method as it is kind of hacky. I would love to have a way to remove those points in a more fool-proof manner that would hopefully also speed up execution, but I'm struggling to figure out if this is possible.

cwchenwang commented 2 months ago

Also interested in this