search

hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.26k stars 189 forks source link

Equirectangular Projection in Rendering #64

Closed hmermerkaya closed 10 months ago

hmermerkaya commented 10 months ago

Hello, As fas as I know, in this repo, only perspective projection has been implemented in rendering. I was just wondering if equirectangular projection is possible in rendering stage like in Nerfstudio, if so, do you guys think of implementing it? If not, can you give me some hint how to do that? Thanks.

guanjunwu commented 10 months ago

Hi, The rendering approach of 4D Gaussian-splatting primarily originates from the deformation field (which accomplishes the conversion from 3D Gaussian + time to 3D Gaussian), and the transformation of 3D Gaussian into a 2D image mainly depends on the rasterization algorithm. This algorithm is derived from 3D Gaussian Splatting (https://github.com/graphdeco-inria/gaussian-splatting). As far as I know, if you need to render in a different way, you might need to modify the CUDA code, which seems nobody has implemented yet.

hmermerkaya commented 10 months ago

Thanks for your reply