turandai / gaussian_surfels

Implementation of the SIGGRAPH 2024 conference paper "High-quality Surface Reconstruction using Gaussian Surfels".
536 stars 26 forks source link

Opacity loss reduces PSNR performance #44

Closed gchhablani closed 2 months ago

gchhablani commented 3 months ago

For some reason, adding the opacity loss reduces performance significantly. If I comment out the loss calculation for opacity, then the PSNR increases from 15 to 20, and I get visibly decent results.

turandai commented 3 months ago

Hi, the opacity loss might push the opacity of semi-transparent points to 0, and those points will be pruned later. This can harm the rendering quality indeed as the number of total points would be much smaller, making the point cloud more compact. Please consider use a smaller weight or turning it off for cases where it does not perform well. I am sorry that the opacity loss generalizes not well on different scenes and is sensitive to the loss weight.