hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.26k stars 189 forks source link

Waymo urban dataset #70

Open antithing opened 10 months ago

antithing commented 10 months ago

Hi, might this implementation work on the waymo urban dataset?

thanks!

guanjunwu commented 10 months ago

I'm not sure. Reconstruction urban scene such as Waymo dataset always need miliions of 3D Gaussians, computing the deformation of all the 3D Gaussians by Gaussian Deformation Network is expensive, but using motion mask to split dynamic and static part may work. And I think Street Gaussians and pvg may have better performance.

huster-wugj commented 4 months ago

I'm not sure. Reconstruction urban scene such as Waymo dataset always need miliions of 3D Gaussians, computing the deformation of all the 3D Gaussians by Gaussian Deformation Network is expensive, but using motion mask to split dynamic and static part may work. And I think Street Gaussians and pvg may have better performance.

I encountered the same problem. In urban scenes, especially the ground with less texture, the effect is very poor. Do you have any good suggestions? Will 4dgs be less effective at reconstructing large scenes than scenes with boundaries?My colleague has tried street gaussian, but the effect is not ideal in weakly textured scenes.

guanjunwu commented 4 months ago

look at this? @antithing @huster-wugj btw, wugj is for my name guanjunwu? :)

huster-wugj commented 4 months ago

look at this? @antithing @huster-wugj btw, wugj is for my name guanjunwu? :)

ha, it my name. im a huster, too.