DepthAnything / Depth-Anything-V2

[NeurIPS 2024] Depth Anything V2. A More Capable Foundation Model for Monocular Depth Estimation
https://depth-anything-v2.github.io
Apache License 2.0
3.95k stars 341 forks source link

Fine-tuning metric depth model #182

Open ysz-leo opened 1 month ago

ysz-leo commented 1 month ago

The relative depth model outputs the inverse depth, while the metric depth model outputs the true depth.So I think it is necessary to use inverse depth to fine-tuning metric depth model, right?

tmagcaya commented 1 month ago

Maybe this is why the metric depth training gets worse over time during fine tuning

xiaodongww commented 1 month ago

Which loss should we use if the inverse depth is used? Should we use SiLogLoss or L2 loss? @tmagcaya @ysz-leo