search

autonomousvision / gaussian-opacity-fields

[SIGGRAPH Asia'24 & TOG] Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenes
https://niujinshuchong.github.io/gaussian-opacity-fields/
Other
660 stars 32 forks source link

Adaptability of the CUDA implementation #71

Open MulinYu opened 1 month ago

MulinYu commented 1 month ago

Hello Zehao,

Congratulations on your impressive work!

I attempted to integrate the GOF CUDA implementation into the original 3DGS and Scaffold-GS. However, I noticed a decrease in rendering quality, approximately 1 dB drop in PSNR. The issue seems to come from the densification. Adding points in distant regions appears to be challenging, resulting in a blurred background. Please see the attached image for reference.

Do you have any insights or suggestions regarding this issue?

bicycle

Best, Mulin

niujinshuchong commented 1 month ago

Hi, I am not familiar with Scaffold-GS codebase. Could you be more specific about what you changed? What is the strategy for adding new points?

MulinYu commented 1 month ago

Hi, I am not familiar with Scaffold-GS codebase. Could you be more specific about what you changed? What is the strategy for adding new points?

Hello, thanks for the reply. I observed the same decrease when integrating the GOF CUDA implementation into the original 3DGS. The only change I made was switching the rendering function.

niujinshuchong commented 1 month ago

OK, I think switching to original 3DGS should work out of box. Do you also use the 3D smoothing filter?

MulinYu commented 1 month ago

OK, I think switching to original 3DGS should work out of box. Do you also use the 3D smoothing filter?

I didn't add the 3D filter but keep the 2D filter in the CUDA part.

niujinshuchong commented 1 month ago

OK, maybe you should set the kernel_size to 0.

MulinYu commented 1 month ago

OK, maybe you should set the kernel_size to 0.

I already set it to 0.

niujinshuchong commented 1 month ago

Then I guess the only difference is the 3D smoothing filter. Maybe you can also try to use it.

MulinYu commented 1 month ago

Then I guess the only difference is the 3D smoothing filter. Maybe you can also try to use it.

Got it, I'll have a try. Thanks again for the reply.

usamex commented 1 month ago

Connected to the CUDA version, is there a reason why this project (and mip-splatting) is using CUDA version 11.3 and not 11.6? Will it work if I install CUDA 11.6 packages instead of 11.3? (IIRC, original 3DGS uses 11.6)

niujinshuchong commented 1 month ago

Hi, I think both cuda version work.