search

fudan-zvg / 4d-gaussian-splatting

[ICLR 2024] Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
MIT License
610 stars 44 forks source link

4DGS on pedestrian within urban scenes #51

Open AutonomierLong opened 2 months ago

AutonomierLong commented 2 months ago

Hi, I'm currently applying 4D Gaussian Splatting to reconstruct pedestrians within an urban scene. However, I'm encountering issues with accurately reconstructing certain parts of the pedestrians, particularly the feet, hands, and legs of some individuals. These regions, which involve faster movement, tend to appear more blurry or distorted in the reconstruction results.

Does anyone have suggestions or advice on how to improve the reconstruction quality for these fast-moving parts? Any insights or recommendations would be greatly appreciated.

Thanks in advance!

Alexander0Yang commented 1 month ago

Hi, @AutonomierLong. Very sorry for the late reply. I think reconstructing pedestrians with subtle movements from few observations in driving scene videos is a little bit ill-posed. According to our experience, it is difficult to really build association between pedestrians across different frames, without appropriate priors as constraint. OmniRe seems to focus on this issue, their approach might be helpful for you.