search

kiri-art / docker-diffusers-api

Diffusers / Stable Diffusion in docker with a REST API, supporting various models, pipelines & schedulers.
https://kiri.art/
MIT License
202 stars 94 forks source link

CLIP guidance #26

Open Hades32 opened 1 year ago

Hades32 commented 1 year ago

Maybe this already works and I just don't know how to pass the relevant config in, but:

Is it possible to use https://github.com/huggingface/diffusers/tree/main/examples/community#clip-guided-stable-diffusion with this container?

gadicc commented 1 year ago

Mmm, not yet :/ I just had a quick look, and we're halfway there.

  1. Community pipeline support - yes
  2. Ability to pass in custom models will require a bit more work
    1. First step - download the models at runtime, shouldn't be too hard.
    2. Second step - cloud-cache with safetensors & ability to build into image

So I think the "first step" should be relatively easy to add, but there's a lot of other stuff I need to finish up first before I'll have a chance to look at this :/ Thanks for opening an issue for this though, would like to get this done (and start looking at some of the other community pipelines too!).