nus-vv-streams / lapis-gs

Official repository of the 3DV 2025 paper "LapisGS: Layered Progressive 3D Gaussian Splatting for Adaptive Streaming"
https://yuang-ian.github.io/lapisgs/
MIT License
10 stars 0 forks source link

Confusion about dynamic opacity #1

Closed renaissanceee closed 2 weeks ago

renaissanceee commented 2 months ago

Thanks for your work. During progressive optimization, the opacities in shallow layers are still learnable to adjust the low-frequency contribution. However, I'm curious about again test at low-resol rendering (x1/8). Will it cause degradation to use the multi-stage optimized opacity in G0? when compared with Gaussians just optimized in first-stage? I notice the delta at L0 in Tab1-4 is always 0, both ssim/lpips and size.

Shiyuang-scu commented 3 weeks ago

Hi, thanks for your interest in our work!

Will it cause degradation to use the multi-stage optimized opacity in G0? when compared with Gaussians just optimized in first-stage?

The motivation of dynamically updating the opacity of lower layers is: (i) lower layers have different visual effect on higher LODs, which requires us to fine-tune these lower layers at higher LOD, and (ii) to keep a compact representation, we don't want to change the foundational features of lower layers.

Optimizing the opacity of the lower layers at different LOD is a way to go. That is, for the same layer, we maintain different lists of opacities at different LODs. To answer your question, when evaluate L0, we don't use the new opacity of G0 updated in L1/2/3, but use the original opacity in G0; similarly, when evaluate L1, we use the opacity of G0 updated in L1 instead of that updated in L0/2/3, so on and so on.

I hope the answer is clear and solve your question!