search

hbb1 / diff-surfel-rasterization

A differentiable rasterizer used in the project "2D Gaussian Splatting"
https://github.com/hbb1/2d-gaussian-splatting
Other
82 stars 15 forks source link

Rendering extra channels #12

Open wuzirui opened 3 weeks ago

wuzirui commented 3 weeks ago

Hi @hbb1, thanks for making this work open-sourced! I wonder whether we can directly use the kernel to render extra channels to implement more applications like feature/semantic rendering. Could we just add the extra channels to the colors_precomp at rasterize_gaussians? And, how can we decode them from the render outputs? Thanks!

hbb1 commented 3 weeks ago

The simplest way is to use colors_precomp for rendering something like feature/semantic fields. However, it only accepts 3 channels. If you want to use N-d features, gsplat can be helpful.