search

mkkellogg / GaussianSplats3D

Three.js-based implementation of 3D Gaussian splatting
MIT License
1.1k stars 135 forks source link

Feature: Accommodating the rendering processes of other improved 3DG methods #179

Open lizhaohanCubeVi opened 3 months ago

lizhaohanCubeVi commented 3 months ago

Recently, there are many improved methods based on vanilla 3D Gaussian splatting. I have found that Scaffold-GS can significantly improve the reconstruction quality. Many scenarios where 3D Gaussian splatting fails to reconstruct can be successfully handled using this method. You can find more information about Scaffold-GS on its GitHub repository: https://github.com/city-super/Scaffold-GS

However, the rendering process of Scaffold-GS differs from the original 3D Gaussian splatting. Perhaps incorporating a Vertex Shader to enable batch processing on anchor points could be effective. Introducing rendering support for Scaffold-GS would be an exciting addition.

Furthermore, would you consider accommodating the rendering processes of other improved methods? Or developing customizable models to facilitate the implementation of rendering for new 3DG algorithms?

gonzalle commented 3 months ago

it looks very promising !

mkkellogg commented 3 months ago

I have definitely thought about good ways to incorporate some of the more recent advances in gaussian splatting. My main concern is that the field is advancing so rapidly that I may put a significant amount of work into something that may be rendered obsolete by a new technique in a few months. I'll definitely keep Scaffold-GS on my radar and if it turns out to have long-term viability I'll probably try to incorporate it.