search

nateraw / stable-diffusion-videos

Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Apache License 2.0
4.36k stars 417 forks source link

add ability to incorporate negative prompts in walk fn #114

Closed nateraw closed 1 year ago

nateraw commented 1 year ago

Issue brought up here. Negative prompts already available in __call__ fn but should be surfaced up to walk. Not sure if you'd want these to be static or also interpolating...

@xtagon We can continue discussion here, would love your thoughts.

xtagon commented 1 year ago

Wow thank you for the quick response! I'm interested in using it for the video interpolation. Would love to be able to set multiple negative prompts, to avoid nsfw and text/signatures.

xtagon commented 1 year ago

Hmm, thinking about htis more, I don't think the negative prompts really have to interpolate themselves. I think each frame should just be able to incorporate the negative prompt, and the main prompt itself should interpolate.

nateraw commented 1 year ago

If that's the case, I just gave it a go...here's a hack for now. I don't think I'll get to this for a little while so you may just wanna use the solution here.

Would love if you report back that certain negative prompts indeed avoid NSFW content! Would be curious to see examples

xtagon commented 1 year ago

Thanks, I'm using it locally instead of in Colab but I don't mind waiting for whenever you get around to it. Thanks again for your help!

evenwestvang commented 1 year ago

Also happy to wait 👍 - in the interim I'll be trying to thread the example through the local library

nateraw commented 1 year ago

This has been added in the latest version of the package! Should work in walk by providing a negative_prompt string arg.

nateraw commented 1 year ago

Please ping here if it's not working as expected and we can open this back up