nnanhuang / S3Gaussian

Official Implementation of Self-Supervised Street Gaussians for Autonomous Driving
Other
392 stars 30 forks source link

Question about rendering results of trained model. #6

Open Kim-GeonU opened 3 months ago

Kim-GeonU commented 3 months ago

Thank you for your great work and open-sourcing your code for the community.

I tried training the sequence 114 in the Waymo open dataset by following your instructions, but the trained results seem to have problems.

image

Above results are saved using following code, which just saves images from render_results in do_evaluation() function. I used 30,000 iterations model.

스크린샷 2024-06-08 오후 10 15 48

And I didn't change any other code except above visualization code.

The above rendering results seem to fail to render dynamic objects and also fail to distinguish between static and dynamic objects. Do you have any idea what causes this problem?

image

These are logs during training.

Thank you!

XuHu0529 commented 3 months ago

I have the same results. It seems to fail to reconstruct the dynamic objects.

tapowanliwuyun commented 3 months ago

Thank you for your great work and open-sourcing your code for the community. I have the same results. Does this mean that the configuration parameters downloaded need to be modified in order to achieve the desired results?

nnanhuang commented 3 months ago

Thank you for your great work and open-sourcing your code for the community.

I tried training the sequence 114 in the Waymo open dataset by following your instructions, but the trained results seem to have problems.

image

Above results are saved using following code, which just saves images from render_results in do_evaluation() function. I used 30,000 iterations model.

스크린샷 2024-06-08 오후 10 15 48

And I didn't change any other code except above visualization code.

The above rendering results seem to fail to render dynamic objects and also fail to distinguish between static and dynamic objects. Do you have any idea what causes this problem?

image

These are logs during training.

Thank you!

Hello! This sequence does not appear in the two main subsets we use, static32 and dynamic32, and our experimental data in the paper align with both emernerf and street gaussian standards. As such, we have not previously encountered this issue. You might consider experimenting with different parameters, for example, reducing the number of training frames. We will investigate this further and study this particular scenario more closely. Thank you for your interest!

nevergone123 commented 3 months ago

I got the similar bad results using scene 754, which is included in the dynamic 32 splits. Below is the dynamic_rgb: image

Do you have any idea to fix it? Many thanks! @nnanhuang

Kim-GeonU commented 3 months ago

I also observed some artifacts in a rendered image from the scene 003 included in the static 32 splits.

image