jy0205 / Pyramid-Flow

Code of Pyramidal Flow Matching for Efficient Video Generative Modeling
https://pyramid-flow.github.io/
MIT License
2.4k stars 233 forks source link

Enhancing the straightness of the flow trajectory. #161

Closed levon-khachatryan closed 2 weeks ago

levon-khachatryan commented 2 weeks ago

Hi!

First of all, congrats on your great work, and thank you for open-sourcing it! Can you explain in more detail why equations 9 and 10 from the paper should enhance the straightness of the flow trajectory?

Thanks in advance.

feifeiobama commented 2 weeks ago

The straightness of the flow trajectory is usually compromised when there are intersections. Sampling the endpoints independently (as in vanilla flow matching) creates random directions for each trajectory and leads to intersections. Instead, by coupling the sampling of these endpoints (as in Equations 9 and 10), we can create more organized, possibly parallel trajectories with fewer intersections, thus improving straightness.

levon-khachatryan commented 2 weeks ago

Thanks for the answer.