hisfog / SfMNeXt-Impl

[AAAI 2024] Official implementation of "SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation", and more.
MIT License
74 stars 11 forks source link

Can we get metric depth ? #21

Open op1009 opened 8 months ago

op1009 commented 8 months ago

Is there any function to get the predicted metric depth from video or image? For my use case, I want metric depth in real time.

hisfog commented 8 months ago

Estimating metric depth from a single image in real-time is very challenging. Currently, the most popular method for monocular metric depth estimation is ZoeDepth, but it probably can't achieve real-time performance. And the KITTI (ConvNeXt-L) model in this repo can also estimate metric depth, but not in real-time. For real-time depth estimation, you can refer to MiDaS. However, MiDaS is unable to estimate metric depth. If you can provide more information about your application, perhaps I can provide you more targeted suggestions.

srikesh-07 commented 8 months ago

Hii @hisfog, I want to estimate the metric depth of the specific objects in outdoor scenarios, such as Poles, Traffic lights etc. Can you please give me any suggestion ?