ShngJZ / WildCamera

Tame a Wild Camera: In-the-Wild Monocular Camera Calibration
Apache License 2.0
47 stars 1 forks source link

How does surface normals module help? #3

Closed jjxjiaxue closed 2 weeks ago

jjxjiaxue commented 3 weeks ago

Hi, thank you for your promising work! I have a few questions about the surface normals priors. Do they play a significant role in the model's performance? If I use a different monocular metric depth estimation model instead of the new-crfs model, can I still input that depth into the incidence head? Will it work just as effectively? Thank you so much.

ShngJZ commented 3 weeks ago

Hi! Thank you for your interest! To perform camera calibration, we do not use either depthmap or surface normal map. The depthmap and surface normal are proof of concept methods where the camera intrinsic is acquirable from the common 3D priors. However, this baseline requires an impractical precision for depth & surface normal. The calibration method benchmarked instead uses the incidence field (as an alternative to the depth & surface normal).

jjxjiaxue commented 2 weeks ago

Thank you so much