CUHK-AIM-Group / EndoGaussian

EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstruction
https://yifliu3.github.io/EndoGaussian/
MIT License
112 stars 6 forks source link

Unstable training results and PSNR is only 5. #25

Closed Beilinlin closed 4 months ago

Beilinlin commented 4 months ago

Dear Author,

I have encountered the same issue as the previous questioner during the training process. In the coarse stage, the training is unstable. Without changing any code or commands, the PSNR values in two coarse stage runs were 25.65 and 5.65 respectively (most of the time, the values are around 5) 图片1 图片2

Additionally, in the fine stage, the PSNR value consistently hovers around 5, and the loss value remains around 0.49. My setup includes an NVIDIA GeForce RTX 4090 GPU with 24564MiB of memory. My CUDA version is 11.7, and my Python version is 3.7.16.

Have you encountered these issues during training? How can they be resolved?

I apologize for the disturbance and greatly appreciate your help!Thank you very much!

yifliu3 commented 4 months ago

Dear Beilinlin,

Thanks for your attention. I just realized that your problem is very similar to the one raised at #11 . Maybe you can check that first.

Beilinlin commented 4 months ago

Thank you very much! After manually downloading the submodules again, the issue has been resolved!