search

ruili3 / awesome-dust3r

🌟A curated list of DUSt3R-related papers and resources, tracking recent advancements using this geometric foundation model.
MIT License
325 stars 8 forks source link

About Depthmap of dust3r #3

Open puyiwen opened 2 months ago

puyiwen commented 2 months ago

Hi, thank you for your work. I want to convert depthmap of dust3r to metric depth, and evaluate on NYU like paper show, how can I do that?

ruili3 commented 2 months ago

Hi, you can follow the demo in DUSt3R to compute the depth map: https://github.com/naver/dust3r/blob/69192aa322d279438390c109b8b85d5b859b5cdd/dust3r/demo.py#L168 Note that DUSt3R's depth map is up to a scale to the real-world depth, so you may have to conduct median/scale-shift alignment to the GT depth before computing the metrics.