AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
139.15k stars 26.41k forks source link

CLIP guided Stable Diffusion #735

Open EnzoAndree opened 1 year ago

EnzoAndree commented 1 year ago

Is your feature request related to a problem? Please describe. It would be great to add support for using CLIP in WebUI. It seems to have better results at the cost of more processing time.

Describe the solution you'd like an option that allows using CLIP in the image generation tabs.

Additional context Here is an implementation.

ProGamerGov commented 1 year ago

There's another implementation of CLIP Guided Stable Diffusion for reference here as well: https://github.com/aicrumb/doohickey/blob/main/Doohickey_Diffusion.ipynb

bbecausereasonss commented 1 year ago

https://github.com/gwang-kim/DiffusionCLIP

WASasquatch commented 1 year ago

I'm surprised this hasn't be added yet. Being stuck to just ViTL14 is, to say the least, unfortunately. There is such better CLIP models with much higher fidelity and creative ability. Even Diffusers has support for changing the CLIP model now, and one can freely reference them for automatic downloading.