DepthAnything / Depth-Anything-V2

Depth Anything V2. A More Capable Foundation Model for Monocular Depth Estimation
https://depth-anything-v2.github.io
Apache License 2.0
3.39k stars 277 forks source link

Issue about max-depth value in metric depth estimation #4

Open lin-voxvision opened 3 months ago

lin-voxvision commented 3 months ago

Hi Dear LiHe, thanks to your fantastic job! This monocular depth estimation will definitely trigger unlimited potential use cases!

I've tried the depth_anything_v2_metric_vkitti_vitl.pth model for outdoor scenes, with a LiDAR ground truth, seems the parameter --max-depth is quite critical to get the absolute depth right.

I also have read your paper, unfortunately no further discussion about metric depth estimation especially the max-depth has been found.

I think most developers would rather implement metric depth estimation in their applications, so it would be much helpful and appreciated if you can guide us how to use metric depth estimation properly!

Here I also attach my test data, so you can verify that! 50

depthanything_test.zip

With this camera, I use --max-path as 65 meters to get the most accurate depth estimation to the LiDAR ground truth, but in metric_depth, it says --max-depth 80 meters. One straightforward question is, how can I get the right --max-depth parameter if without ground truth? I also wonder what if the real max depth is greater than 80 meters, like said 100 even 200 meters?

Thanks again for your hard work!

lin-voxvision commented 2 months ago

Hi team, any updates on this topic?

elvistheyo commented 1 month ago

@lin-voxvision did you find out how to figure out the max-depth?

lin-voxvision commented 1 month ago

@lin-voxvision did you find out how to figure out the max-depth?

Sadly, no