search

clarte53 / GaussianSplattingVRViewerUnity

A VR viewer for gaussian splatting models developped as native plugin for unity with the original CUDA rasterizer.
Other
250 stars 30 forks source link

Using gaussian splatting's alpha channel #7

Closed hailsong closed 1 year ago

hailsong commented 1 year ago

Thank you for the nice work! This repository gave me a lot of inspirations.

I wanna test object representation using gaussian splatting with this code.

What I wanna ask you is that, is there any way to get alpha channel of rendered results? In the unity code, it seems that the rendered image from .dll file is sent to textures connected to XR Origin - Camera Offset - Main Camera. But the transparent parts looks black.

Can I modify it to transparent? (for example, showing unity's skybox or boundary scene when some part is empty...)

Peamon commented 1 year ago

For now, the Gaussian splatting rasteriser work in RGB so it force black pixel for the background. I will see if i can do someting for this but i'm not sure that is possible.

hailsong commented 1 year ago

Thank you for responding!