autonomousvision / mip-splatting

[CVPR'24 Best Student Paper] Mip-Splatting: Alias-free 3D Gaussian Splatting
https://niujinshuchong.github.io/mip-splatting/
Other
1.01k stars 65 forks source link

radii > 0 - CUDA error illegal access memory #20

Open gaetan-landreau opened 6 months ago

gaetan-landreau commented 6 months ago

Hi !

Currently trying to give a try to your method on a custom scene I have but I'm facing quite a disturbing and strange issue. Training starts well, but at some points, I got some CUDA-kernel error I cannot get.

I highly suspect an issue related to the gaussians.compute_3D_filter method (https://github.com/autonomousvision/mip-splatting/blob/746a17c9a906be256ed85b8fe18632f5d53e832d/train.py#L164C1-L165C1) but I don't manage to investigate in a deeper way the error.

I've found some similar issue in the original GS repo (here: https://github.com/graphdeco-inria/gaussian-splatting/issues/41#issuecomment-1752279620), made the corresponding changes by rebuilding the diff-gaussian-rasterizer submodule, but I still get the error.

Here is the log stack I get.

Screenshot 2024-02-16 at 16 38 20

Do you have any clues / insights on what's happening and why ?

Thanks a lot for your time, your work,

Best,

Gaétan.

niujinshuchong commented 6 months ago

Hi, not sure what’s wrong. Do you find a solution in the end?

zhouilu commented 5 months ago

I meet the similar problem. Have you fixed it up?

wrencanfly commented 4 months ago

Have you fixed it up?

wrencanfly commented 4 months ago

I meet the similar problem. Have you fixed it up?

I fixed the problem by using a new WSL machine with cuda 118