hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.26k stars 189 forks source link

Rendering Quality of hypernerf split-cookie scene #36

Closed whwjdqls closed 1 year ago

whwjdqls commented 1 year ago

hi, thanks for this great research paper. While I was playing with the code, I found multiple cases where the results did not match the results shown in the paper and the project page. As the project page shows a good result on hypernerf cookie-split dataset, these are the rendering quality after training with the script files in the repo.

image

image

I was wondering if there are any more details on this specific scene as the results are not reproducible.

guanjunwu commented 1 year ago

you can generate point clouds by colmap using training images. The code will be updated soon when I have time. To be honest. I also found that 4DGS is a direct and naive approach to solving dynamic scenes. It only works very well in synthesis datasets and has no explicit advantage compared to other dynamic NeRFs except rendering speed (maybe 4DGS have but I haven't achieved that). And in my opinion, 4DGS can also perform tracking and editing like dynamic3dgs

I do think more prior should be adopted (such as optical flow) in monocular scenes and using methods like 4K4D, Im4D in multi-cam setup can achieve better rendering quality.

whwjdqls commented 1 year ago

Thanks for the prompt reply and your opinion.

Hope you guys keep up the great work! 👍

guanjunwu commented 1 year ago

btw, you can set batch_size = 4 and training iteration=14000. It works in my machine. cancel opacity reset interval may also helps.