search

szymanowiczs / splatter-image

Official implementation of `Splatter Image: Ultra-Fast Single-View 3D Reconstruction' CVPR 2024
https://szymanowiczs.github.io/splatter-image
BSD 3-Clause "New" or "Revised" License
795 stars 54 forks source link

about sh_degree #26

Closed johnren-code closed 4 months ago

johnren-code commented 5 months ago

I would like to know why sh_degree is set to only 1, can I try a larger value?

johnren-code commented 5 months ago

what's more, if I want to render a multi-channel image instead of an RGB image, how do I change the code?

huoxingdawang commented 4 months ago

In my opinion, if you want to render a multi-channel image, may be you should modify the 3DGS renderer, which is write in cuda.

Maybe like some segmentation work? gaussian-grouping

szymanowiczs commented 4 months ago

For rendering features you would need to modify the rasterizer - I think there are some forks of the gaussian splatting repository that render features.

You can definitely try more spherical harmonics - it will work for a single image when the input camera is identity. Unfortunately rotating spherical harmonics of order more than 1 is a bit more involved so you would need to deal with that if you want to transform between reference frames (but if you have only one image you can just modify the camera poses so that the source camera is identity)