How to add reference image as the starting frame of the video?

PKU-YuanGroup / Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

MIT License

11.34k stars 1.01k forks source link

Open IranQin opened 6 months ago

IranQin commented 6 months ago

Nice work! If I have an image and a piece of text, how do I generate a video with the given image as the starting frame based on that text?

clumsynope commented 4 months ago

Same question. @IranQin Have you solve it?

AlphaNext commented 4 months ago

Same question. +1

IranQin commented 4 months ago

I just implemented this function myself.

clumsynope commented 4 months ago

How do you implement it? Could you give me some suggestions.

trouble-maker007 commented 3 months ago

@IranQin Would you like to share the function?