search

nateraw / stable-diffusion-videos

Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Apache License 2.0
4.42k stars 421 forks source link

Why are the frames all required to be from different seeds? #194

Open jimc4893 opened 1 year ago

jimc4893 commented 1 year ago

Is there no way to use one base seed and have it altered for each frame so it animates and doesnt just move to a completely new image for each frame?

nateraw commented 1 year ago

the seeds aren't required to be different. you could pass a list of all the same seed if you wanted. :)

jimc4893 commented 1 year ago

from my usage, you can't animate a single prompt without it being unstable due to it simply being frames changing if you use multiple seeds. if you use the same seed, the image doesnt change. so are you expecting people to use this tool so that the prompt changes with the image every second? because even when i do that, there are very abrupt swaps that make it unusable.

it's a good idea and the implementation for music is good, i'd like to see these issues addressed though.

jimc4893 commented 1 year ago

perhaps you could add a zoom option like other diffusion setups?