nateraw / stable-diffusion-videos

Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Apache License 2.0
4.44k stars 422 forks source link

add stable diffusion inpainting for videos #26

Open nateraw opened 2 years ago

nateraw commented 2 years ago

We'd have to discuss an API for this. Perhaps its 2 video inputs, one with source, other with masks. Iterate over frames here. Not sure if any wonkiness could come out of this approach though...

Probably better to take in 2 directories or 1 directory w/ file names denoting which are masks and which are src images.