Applying Reactor and/or InstantID on segs

[InspectaGadget]

Hi ! I'm trying to re-set in a1111 the workflow I usually apply in ComfyUI : Applying Reactor and InstantID on segs.

Your extension is awesome ! But dealing with a1111 architecture i feel a little bit lost about how to "link" different extensions. Do you think it could be possible via a script ?

In the case that isn't clear enough i precise i would like to :

• Generate a picture in text2img
• Get a segment mask of the face (let's talk about one only), let's say with face_yolov8m-seg_60.pt for exemple
• Apply Reactor on this SEGS
• Get a segment mask of the swap face, let's say with face_yolov8m-seg_60.pt for exemple
• Apply InstantID on this SEGS
• Get the final picture

My aim is to NOT have to do this things in a post-traitement (in img2img for example), but using the initial generated pic/latent/prompts/seed, etc

Big thanks by advance if you find so motivation to answer this question !

[wkpark]

the uddetailer currently does not support customizable workflows, support only specific workflow internally,

• internally, uddetailer use img2img method with generated inpainting masks.
• inpainting will be done with some script extensions. e.g) LoraBlockWeight, dynamic-prompt, Dynamic Threashold, etc.
• programmed workflows with generated masks A (single or many) and mask-B
  1. A-masks and B-mask operation to get new one single C mask ->inpainting with C-mask
  2. pre-inpainting with mask-B -> inpainting with A-masks (loop over all A-mask)
  3. A-masks -> inpainting with A-masks and controlnet workflow also supported. (in this case, inpainting process will be down with controlnet)

---

so you just want to use uddetailer as an bbox/segms detector and use the masks/segms of the detected results an inputs of the Reactor/InstantID?

[InspectaGadget]

Thanks for answer. Yes, as you said, using the masks/segms of the detected results as an inputs of the Reactor/InstantID is exactly my aim, like i'm doing in ComfyUI. Maybe this isn't really the aim of your extension, and if so i'm sorry to want to use it this way. The fact is i'm a bit new to a1111, and this is in your extension that i better had the feeling of finding my bearings about segmenting. Have you maybe some ideas about how i could achieve this aim (in a1111) ?