Mikubill / sd-webui-controlnet

WebUI extension for ControlNet
GNU General Public License v3.0
17.1k stars 1.97k forks source link

Support ProMax union model #2998

Closed huchenlei closed 4 months ago

huchenlei commented 4 months ago

The promax union model supports 2 new control types: Tile and Inpaint. You can download the model here: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0/tree/main

Tile

image image

1girl, hatsune miku,, absurdres, highres, (masterpiece:1.2), (best quality, highest quality),
Negative prompt: (lowres, low quality, worst quality:1.2), (text:1.2), watermark, (frame:1.2), deformed, ugly, deformed eyes, blur, out of focus, blurry, deformed cat, deformed, photo, anthropomorphic cat, monochrome, photo, pet collar, gun, weapon, blue, 3d, drones, drone, buildings in background, green
Steps: 30, Sampler: DPM++ 2M, Schedule type: Karras, CFG scale: 7, Seed: 3582562933, Size: 768x1024, Model hash: 5a268fde84, Model: netaArtXL_v10, Clip skip: 2, ControlNet 0: "Module: blur_gaussian, Model: controlnet++_union_promax_sdxl [9460e4db], Weight: 1.0, Resize Mode: Crop and Resize, Processor Res: 512, Threshold A: 9.0, Threshold B: 0.5, Guidance Start: 0.0, Guidance End: 1.0, Pixel Perfect: False, Control Mode: Balanced", Version: v1.9.4-253-gb2453d28

image image

absurdres, highres, (masterpiece:1.2), (best quality, highest quality),
Negative prompt: (lowres, low quality, worst quality:1.2), (text:1.2), watermark, (frame:1.2), deformed, ugly, deformed eyes, blur, out of focus, blurry, deformed cat, deformed, photo, anthropomorphic cat, monochrome, photo, pet collar, gun, weapon, blue, 3d, drones, drone, buildings in background, green
Steps: 20, Sampler: DPM++ 2M, Schedule type: Karras, CFG scale: 7, Seed: 3086528334, Size: 768x1024, Model hash: 5a268fde84, Model: netaArtXL_v10, Clip skip: 2, ControlNet 0: "Module: blur_gaussian, Model: controlnet++_union_promax_sdxl [9460e4db], Weight: 1.0, Resize Mode: Crop and Resize, Processor Res: 512, Threshold A: 9.0, Threshold B: 0.5, Guidance Start: 0.0, Guidance End: 1.0, Pixel Perfect: False, Control Mode: Balanced", Version: v1.9.4-253-gb2453d28

Inpaint

Does not work right now. Need to wait author update inference script in https://github.com/xinsir6/ControlNetPlus/tree/main. It probably uses different protocol for inpaint comparing to the current impl in sd-webui-controlnet.

light-and-ray commented 3 months ago

Inpaint: Does not work right now

I can get something. Just use "None" preprocessor + pixel perfect (to avoid blur) + image where black pixels mean mask. This comfy workflow do the same

00008-1835962484-a face of cat ComfyUI_00008_

You can get masking workflow from metadata

But there is still a black contour, I think someone somewhere resizes it

@huchenlei

light-and-ray commented 3 months ago

Ah yes this: Resize Mode Just Resize Crop and Resize Resize and Fill