hisfog / SfMNeXt-Impl

[AAAI 2024] Official implementation of "SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation", and more.
MIT License
91 stars 12 forks source link

Can we get metric depth ? #21

Open op1009 opened 1 year ago

op1009 commented 1 year ago

Is there any function to get the predicted metric depth from video or image? For my use case, I want metric depth in real time.

hisfog commented 1 year ago

Estimating metric depth from a single image in real-time is very challenging. Currently, the most popular method for monocular metric depth estimation is ZoeDepth, but it probably can't achieve real-time performance. And the KITTI (ConvNeXt-L) model in this repo can also estimate metric depth, but not in real-time. For real-time depth estimation, you can refer to MiDaS. However, MiDaS is unable to estimate metric depth. If you can provide more information about your application, perhaps I can provide you more targeted suggestions.

srikesh-07 commented 1 year ago

Hii @hisfog, I want to estimate the metric depth of the specific objects in outdoor scenarios, such as Poles, Traffic lights etc. Can you please give me any suggestion ?