deforum-art / deforum-stable-diffusion

https://deforum.github.io/
Other
2.21k stars 388 forks source link

Support for Stable Diffusion 2.0 #56

Closed eran-sefirot closed 1 year ago

eran-sefirot commented 1 year ago

Hey, Thanks for this amazing art framework!

Does the framework support stable diffusion 2.0? I am trying to render animation using the existing framework but experience some weird behaviour

Thanks

kabachuha commented 1 year ago

The dev branch https://github.com/deforum-art/deforum-stable-diffusion/tree/dev should have support for 2.0, but there are some bugs reported

eran-sefirot commented 1 year ago

What changed ? I mean migration from 1.4 to 1.5 was smooth..

Thanks I’ll deploy it to our dev servers.

On Sun, 4 Dec 2022 at 15:44 kabachuha @.***> wrote:

The dev branch https://github.com/deforum-art/deforum-stable-diffusion/tree/dev should have support for 2.0, but there are some bugs reported

— Reply to this email directly, view it on GitHub https://github.com/deforum-art/deforum-stable-diffusion/issues/56#issuecomment-1336415504, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWXQ6QF4EWMQMIWB73GQXNTWLSN5BANCNFSM6AAAAAASTKRKRQ . You are receiving this because you authored the thread.Message ID: @.***>

kabachuha commented 1 year ago

The default resolution moved from 768^2 to 512^2 in 2.0 which helped many spatially complex things such as hands, wings, realistic landscapes, machinery or jewelry. Its main downside is dataset shrinking due to potential legal troubles, StabilityAI removed many the living artists from the database as well as any potential nsfw content. But I'm sure there will be a plenty of finetuned 2.0 derivatives extremely soon

theguaz commented 1 year ago

Suscribed to this, specially interested into using the new 512-depth-ema.ckpt model with each frame of an extraction from video :)

deforum commented 1 year ago

added