Somebody made a SDXL Segmentation control net!

Acly / krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

https://www.interstice.cloud

GNU General Public License v3.0

6.47k stars 312 forks source link

Somebody made a SDXL Segmentation control net! #849

Closed FeepingCreature closed 2 months ago

FeepingCreature commented 3 months ago

https://huggingface.co/abovzv/sdxl_segmentation_controlnet_ade20k/tree/main

Found it in the comments for https://www.reddit.com/r/StableDiffusion/comments/16nqzzh/is_there_a_segmentation_model_for_sdxl_controlnet/

Do we need anything else to enable support for segmentation layer for SDXL networks?

Acly commented 3 months ago

I added it to the search path, it actually works pretty well. 5 GB though... (might be fp32)

Acly commented 2 months ago

v1.21.0 has support for xinsir union CN, which also happens to work pretty well for segmentation. So separate CN is no longer strictly needed (but it still works).