hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.26k stars 189 forks source link

Severe artifacts in N3dv coffee scene #22

Closed Friedrich-M closed 1 year ago

Friedrich-M commented 1 year ago

When I run the code using the command as follows:

export CUDA_VISIBLE_DEVICES=2
expname='coffee_martini'
port=6080
python train.py -s data/dynerf/${expname} --port ${port} --expname "dynerf/${expname}" --configs arguments/dynerf/default.py  &
wait
python render.py --model_path output/dynerf/${expname} --configs arguments/dynerf/default.py --skip_train --skip_test &
wait
python metrics.py --model_path output/dynerf/${expname}/  &
wait
echo "Done"

I found the rendered video has a lot of artifacts and the quality seems much lower than it is in the paper.

https://drive.google.com/file/d/14QJRuNAjHiPiHqyHM1aCiOfEXYWb2vP-/view?usp=sharing

guanjunwu commented 1 year ago

Indeed, in this version of our code, 4D-GS cannot perform very well in the scenes with out-door backgrounds(due to the lack of point clouds initialization). We are working hard to improve the rendering quality :)

Friedrich-M commented 1 year ago

Thank you for your reply. I was wondering if there are any scenes that perform relatively well on n3dv?

guanjunwu commented 1 year ago

https://github.com/masked-spacetime-hashing/msth

Friedrich-M commented 1 year ago

I've run their code through this open-source repository, but I found their current version of the code to be messy and didn't test very well.

img_30000_01a2e473b522f76b6ab7

guanjunwu commented 1 year ago

It seems that HexPlane and KPlanes may help you :) btw, you can check the results comparasion mentioned in papers.