search

CUHK-AIM-Group / LGS

[MICCAI 2024] LGS: A Light-weight 4D Gaussian Splatting for Efficient Surgical Scene Reconstruction
https://lgs-endo.github.io/
Other
37 stars 1 forks source link

Rendering Issue: student_image and teacher_image are Completely Black #5

Closed POYOki closed 1 month ago

POYOki commented 1 month ago

Hi,

I am currently trying to reproduce the results of your work, but I have encountered an issue that I cannot resolve. Here are the steps I have taken so far:

I used EndoGaussian to run pulling and saved the teacher_model to the data directory. I initialized teacher_gaussian and teacher_scene using the saved teacher_model. During the training process, I need to render student_image and teacher_image. However, both student_image and teacher_image are completely black. I have not modified your code and have correctly installed compress-diff-gaussian-rasterization and simple_knn.

Upon investigating further, I found that in gaussian_render, the color returned by the rasterizer is all zeros.

Here is a summary of my setup and the issue:

Environment: Python version: 3,7,16 OS: ubuntu 18

Steps to Reproduce: Run EndoGaussian with pulling and save teacher_model. Initialize teacher_gaussian and teacher_scene with the saved teacher_model. Attempt to render student_image and teacher_image during training.

Observed Behavior: Both student_image and teacher_image are completely black. The color returned by the rasterizer in gaussian_render is all zeros.

Expected Behavior: student_image and teacher_image should be rendered correctly with visible content. I have double-checked the installation of the required packages and ensured that I followed the instructions correctly. Despite this, I am unable to identify the root cause of the issue.

Additional Information: When using EndoGaussian, I am able to render content normally. This issue only occurs during the training process when rendering student_image and teacher_image.

Could you please provide any insights or suggestions on how to resolve this problem? Is there any additional debugging information I can provide to help diagnose the issue?

Thank you for your assistance.

Best regards！

LiuHengyu321 commented 1 month ago

Hi @POYOki!

Thank you for your interest in our work! I appreciate your patience while I was on holiday.

Would you like to try using the new configuration for training a teacher model as mentioned here or the the way to fix the index error ?

Caizeyu116 commented 1 month ago

Hello! I noticed that you encountered an issue that I'm currently facing as well. Could you share how you managed to resolve it? I’m looking forward to your reply and any advice you can provide. Thank you!