search

Zerg-Overmind / GaussianFlow

GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
https://zerg-overmind.github.io/GaussianFlow.github.io/
157 stars 3 forks source link

missing optical flow results of videoflow #6

Closed tb2-sy closed 6 months ago

tb2-sy commented 6 months ago

Sorry to bother you again, in your paper you mentioned forward flow for supervision, but my videoflow results are missing the forward flow from 0001 to 0002, what should I do? cba6b8f7d7d953012aa634dc729a1c8c

tb2-sy commented 6 months ago

Another question is the shape of predicted_flow_by_gs.sum(0) is [1080, 1920, 2], but videoflow optical_flow shape have 3 channels, how to use optical flow to supervise predicted flow? Looking forward to your reply.

Zerg-Overmind commented 6 months ago

Hi, the output of videoflow is [H,W,2], what you got here are the rgb images for visualization, not the raw optical flow. Also, you should carefully check the issues (for example this) and the readme file of videoflow because the way they calculating optical flow includes both forward and backward flow (if I remember correctly), you will need to pick out only forward ones for usage.