Add color control net plz

[xueqing0622]

Add color control net plz, stable diffusion is very hard to control color, The Colors easily pollute each other and make mistake. if can ,Add color control net plz. Someone can add this to pull requests plz.

[xiankgx]

Color control is something img2img in the original SD is about.

[ninjasaid2k]

Have you tried combining img2img with Controlnet?

[xueqing0622]

No, still in txt2img, just like canny or Scribbles add color theme below, Canny or scribbles is very nice to control the shape of image, But as I say stable diffusion is very hard to control color, The Colors easily pollute each other and make mistake. we still need color control in control net to control the color,

Let me use a picture to explane what I mean: https://imgur.com/a/oqxi58M https://imgur.com/a/oqxi58M （pls copy and new window to open the image，I don't know how to add image in github） just like picture, we have 1, the canny or scribbles mode now. And now we need the new mode like 2 " line and color mode", to control the color for final result' s color, like 3

Control net is best tool for stable diffusion, I hope it can control the color theme too.

[xueqing0622]

The img2img use control net can do same thing, but 1 should drag picture twice, 2 should make line no so strong 3 must to preprocessor 4 use more gpu 5 the result no as good as txt2img because the Denoising strength no good to control

[jinxixiang]

I don't know whether the spatial palette mode in T2I adapter can fulfill your requirements. https://github.com/TencentARC/T2I-Adapter

[loboere]

yes , we urgently need a control for color, img2img is not very good for color control because img2img not only influences the color of the output but also influences the geometry and style the lower the strength but we want to leave these last two intact, T2I control doesn't work very well

[jinxixiang]

yes , we urgently need a control for color, img2img is not very good for color control because img2img not only influences the color of the output but also influences the geometry and style the lower the strength but we want to leave these last two intact, T2I control doesn't work very well

we make a simple extension for proof of concept. FYI. https://github.com/jinxixiang/color_controlnet

[loboere]

@jinxixiang interesting, can I use your color model with this Mikubill extension?

[jinxixiang]

@loboere Sure, we plan to release a Webui demo later.

[lsycxyj]

Any progress?