autonomousvision / mip-splatting

[CVPR'24 Best Student Paper] Mip-Splatting: Alias-free 3D Gaussian Splatting
https://niujinshuchong.github.io/mip-splatting/
Other
1.01k stars 65 forks source link

The low-pass filter in Eq. 8 and Eq. 9 #5

Closed DapengFeng closed 6 months ago

DapengFeng commented 9 months ago

Thank you for your work! I have a question about the low-pass filter in Eq. 8 and Eq.9, i.e., how do you construct it?

zf-666 commented 8 months ago

Same question, looking at the paper it should be limiting cov3d based on depth and f during computation, but I can't find the related code.

niujinshuchong commented 8 months ago

The 3D filter can be found here: https://github.com/autonomousvision/mip-splatting/blob/main/scene/gaussian_model.py#L126-L137 and the 2D filter is here: https://github.com/autonomousvision/mip-splatting/blob/main/submodules/diff-gaussian-rasterization/cuda_rasterizer/forward.cu#L111-L123

SYSUykLin commented 7 months ago

The 3D filter can be found here: https://github.com/autonomousvision/mip-splatting/blob/main/scene/gaussian_model.py#L126-L137 and the 2D filter is here: https://github.com/autonomousvision/mip-splatting/blob/main/submodules/diff-gaussian-rasterization/cuda_rasterizer/forward.cu#L111-L123

Are these the only two changes compared to 3D GS?

SYSUykLin commented 7 months ago

The 3D filter can be found here: https://github.com/autonomousvision/mip-splatting/blob/main/scene/gaussian_model.py#L126-L137 and the 2D filter is here: https://github.com/autonomousvision/mip-splatting/blob/main/submodules/diff-gaussian-rasterization/cuda_rasterizer/forward.cu#L111-L123

And the eq7, did u omit the gaussian which outside the camera frustum? I did not find the code in in_frustum of the anxiliary.h file.

niujinshuchong commented 7 months ago

Hi, the in_frustum code is here: https://github.com/autonomousvision/mip-splatting/blob/main/scene/gaussian_model.py#L175