fudan-zvg / 4d-gaussian-splatting

[ICLR 2024] Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
MIT License
556 stars 39 forks source link

How to enable the optical flow function? #28

Open GANWANSHUI opened 6 months ago

GANWANSHUI commented 6 months ago

Hi, thanks a lot for sharing the excellent work.

I tried to train the 4dgs under the synthesis scene (dnerf), but the output flow value is zero how to enable the optical flow function? Or did I miss anything?

Thanks again!

XLY43 commented 5 months ago

Hi did you figure it out?

GANWANSHUI commented 5 months ago

Not yet. An alternative is calculating the offset between two frames, which should derive the optical flow.

STLAND-admin commented 2 months ago

Hi did you figure it out? I tried to visualize the offset but it is not right

qrcat commented 1 month ago

The flow is compute by flow_2d as input, and it just use volume render to display flow_2d.