search

NVlabs / nvdiffrec

Official code for the CVPR 2022 (oral) paper "Extracting Triangular 3D Models, Materials, and Lighting From Images".
Other
2.09k stars 222 forks source link

holes on metal spot #99

Closed Zyq-scut closed 1 year ago

Zyq-scut commented 1 year ago

Hi, thanks for your excellent work. I try to generate metal spot without base mesh. However, there are many 'holes' on the result mesh. Is it too hard for the network to fix? How can I get a smooth mesh for the metal object? image

jmunkberg commented 1 year ago

Hello @Zyq-scut ,

Joint optimization of shape, materials, and lighting for highly specular objects is quite challenging. The smoothness regularizer here https://github.com/NVlabs/nvdiffrecmc/blob/main/geometry/dmtet.py#L240 may help somewhat (the term that penalizes differences in normal gradients).

Zyq-scut commented 1 year ago

Thanks for your reply. I will try to train with smoothness regularizer later.