hbb1 / 2d-gaussian-splatting

[SIGGRAPH'24] 2D Gaussian Splatting for Geometrically Accurate Radiance Fields
https://surfsplatting.github.io
Other
1.95k stars 124 forks source link

img resolution #63

Closed chenqi13814529300 closed 3 months ago

chenqi13814529300 commented 4 months ago

Your work is great, but I have a problem. When I train with a resolution of around 5000, it's almost impossible to train. My graphics card is 4090, and the running memory is 128GB. I hope you can provide suggestions.

hbb1 commented 4 months ago

Hi, how much images did you load into the GPU? By the way, 5000 is clearly too large ...

chenqi13814529300 commented 4 months ago

It's actually thousands of images, and I did tile segmentation. About 400 tiles per tile. High resolution images are actually needed

hbb1 commented 4 months ago

you can store images in CPU.

chenqi13814529300 commented 4 months ago

thank!

chenqi13814529300 commented 4 months ago

I tried using steel tower data for testing, and your algorithm performs much better than ordinary algorithms. But the performance of indoor data is not very good, do you need additional tuning. (I have tried 0 and 1 for depth'ratio, and all other parameters have been set to default values)

hbb1 commented 4 months ago

Hi, can you show up some visualizations here. Since the scale of the scenes is different, and our regularization is correlated to the scale, e.g, depth range, sometimes we should adjust the scale of regularization to achieve better results.

chenqi13814529300 commented 4 months ago

微信截图_20240607174044 微信截图_20240607174108

chenqi13814529300 commented 4 months ago

The first one used AtomGS. The second one used your algorithm (median depth was used, and average depth worked similarly). The training is done with laser point clouds.

hbb1 commented 4 months ago

Since indoor and outdoor are a relative concert, it does not reflect the absolute scene's scale. So tuning the weight for depth-related regularization is needed. If AtomGS works well without distortion regularization, then you can try to disable regularization for 2DGS.

chenqi13814529300 commented 3 months ago

Okay, thanks for the answer.