zju3dv / PGSR

[TVCG2024] PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction
https://zju3dv.github.io/pgsr/
Other
513 stars 35 forks source link

About Monocular Depth or Normal Loss #33

Open buddyhs opened 2 months ago

buddyhs commented 2 months ago

Thank you for your excellent work. The training results are very good. I have another question. Since PGSR can already render depth maps and normal vectors, can the current code add single-purpose depth or normal losses to constrain more accurate model generation?

ywcmaike commented 2 months ago

It depends on the generalization ability of the pretrained depth or normal models. From my perspective, in the texture-less areas or some ambiguous areas, using the prior of the pretrained normal or depth model may help improve the quality of the surface reconstruction.