search

cloneofsimo / paint-with-words-sd

Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.
MIT License
636 stars 52 forks source link

Extensions for Automatic1111 version? #1

Open mykeehu opened 2 years ago

mykeehu commented 2 years ago

It's a great utility! I would be very happy if you could make this as an extension for the Automatic1111 version too! Thank you very much in advance!

cloneofsimo commented 2 years ago

This would be a fantastic idea, but I think using Gradio's interface for many-color painting would be very unpleasing...

mykeehu commented 2 years ago

The first step would be to upload a pre-painted image. I don't know how the painting works in Gradio, but an extra blur slider would adjust the colour/finish transitions. I would use this partly as an alternative to Pix2Pix. There are already color tagged images there that I could convert to SD.

cloneofsimo commented 2 years ago

Sure thing. right now Im not so familiar with Gradio, but Ill look forward to add these in A1111 extension

cloneofsimo commented 2 years ago

For anyone elses information, there is canonical request on a1111's repo as well.

https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/4406 , which is very constructive and relevant.

jinwonkim93 commented 2 years ago

This might help you masking with color. https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/3865 @cloneofsimo

Padusarbor commented 2 years ago

This would be a fantastic idea, but I think using Gradio's interface for many-color painting would be very unpleasing...

There's also the krita extension which can be helpful with that.

0xdevalias commented 2 years ago

Here's the corresponding issue to this on the automatic1111 repo: