huggingface / gsplat.js

JavaScript Gaussian Splatting library.
MIT License
1.26k stars 77 forks source link

Feature suggestion - sky-fill #61

Open murcje opened 4 months ago

murcje commented 4 months ago

Hi and thanks again for your fine work.

I have no coding experience so please forgive my potentially blatent ignorance.

I generally capture splats from above with an orbital camera path, I make several orbits at different heights and angles. It is always hard to get a full sky coverage. A posssible solution imo could be to have a giant sky sphere with black below the horizon (because holes in the splatting generally need black there) and the upper half colored with an average of the colors of the sky splats. I could make such a texture map easily but it would have to be done for each splat in a manual way.

Would it be possible to have this skysphere created with code, choosing the right sky-fill automatically?

simonbethke commented 3 months ago

I also thought about this a bit. Maybe it is easy to add outside of gsplat. It would require something like a background 'skybox'. Either one can provide an actual spherical panorama or otherwise it could even be helpful to simply set a ground and a sky color and conect both with a short gradient at the horizon. Especially tree-branches usually pick up a bit of sky-color, while the ground needs to be rendered in front of a darker color.