search

aras-p / UnityGaussianSplatting

Toy Gaussian Splatting visualization in Unity
MIT License
2.09k stars 239 forks source link

Support Scaffold-GS rendering #84

Closed bmikaili closed 7 months ago

bmikaili commented 9 months ago

How hard would it be to adjust the code to support the .ply files this puts out? https://github.com/city-super/Scaffold-GS

aras-p commented 9 months ago

Is there some overview/writeup where one can figure out what their .ply files contain?

bmikaili commented 9 months ago

Hmm, there's no simple writeup yet and I haven't gotten to digesting the paper yet. I guess once they release their rendering code it's easier to understand

inspirelt commented 8 months ago

Hi, thanks for your interests in our work. In scaffold-GS, the scene is structured by a set of voxelized anchors, and each anchor distributes dynamic number of gaussian points for rendering. The .ply stores feature vectors and offsets for each gaussian point. Properties, including color, opacity, scaling and rotation, are decoded from the features using MLPs. We've released a viewer based on the SIBR_viewers. Please feel free to try.

luuude commented 8 months ago

Oh that would be awesome! Scaffold-GS is quite an update!

aras-p commented 7 months ago

FWIW I'm not planning to add that, but anyone else can of course try doing it.