jy0205 / Pyramid-Flow

Code of Pyramidal Flow Matching for Efficient Video Generative Modeling
https://pyramid-flow.github.io/
MIT License
2.4k stars 233 forks source link

Is the image to video prompt working? #190

Open cocktailpeanut opened 5 days ago

cocktailpeanut commented 5 days ago

First of all, I did manage to get through all the issues I've been experiencing previously and everything is working great.

I can confirm no VRAM issues, both for the small model and the large model (I'm using the gradio app and I'm on a 4090).

The only problem I'm experiencing is that the image to video--while it generates some great videos--doesn't seem to reflect the prompt at all. For example I have an image of a boy standing, and I entered the prompt "The boy is walking". I tried many many times but never got one video that actually had the boy walking.

Which makes me wonder, am I doing something wrong? Is image-to-video prompting working for everyone else?