huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
26.27k stars 5.41k forks source link

Image to Video Pipeline #2883

Open tonymacx86PRO opened 1 year ago

tonymacx86PRO commented 1 year ago

Model/Pipeline/Scheduler description

How will this new pipeline work You give a image and using the denoising strength adds noise to first frame and adding it to temporal memory Output: Making from first image makes a sequence frame that represents a animation or video from the first frame This very cool addition to text to video pipeline

If you have denoising strength of 0 u don't change the first frame and add it to temporal memory if you have 1 it will completely change the first frame and add it to temporal memory

Open source status

Provide useful links for the implementation

No response

tonymacx86PRO commented 1 year ago

Any progress?