weiyithu / SurroundDepth

[CoRL 2022] SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation
MIT License
247 stars 38 forks source link

About focal_scale #21

Open DongyangHuLi opened 11 months ago

DongyangHuLi commented 11 months ago

Hi, thank you for nice work! I'm confused about the 'focal_scale'. Why do we need to do this: https://github.com/weiyithu/SurroundDepth/blob/22dfecfe8fca62a38d0f682ff7bf65b41aba3cac/runer.py#L382-L383

weiyithu commented 11 months ago

Depth estimation results are related to focal length. Here we encode focal length information to the network by simply multiply a focal scale. For a more elegant method and the theoretical relation between focal length and depth, you may refer to this paper: Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image.