Amazing tool, but Can I add object classes?

[tanuki-create]

For example, can I add 'Can' as the object class? or Should I train the segmentation model?

Is there any way to select additional class?

I would like to use segment models for regenerating 'coffee can' which a person holds.

Thank you master, this is a great tool.

[wkpark]

segm/ yolov5_ins*.pth models support coco Instance segmentation (see also https://github.com/open-mmlab/mmyolo/tree/main/configs/yolov5 ) and you can select any COCO class objects.

in this case, you can use "Inpainting Helper" after "Generate" an image.

• COCO class supports 81 predefined classes.

---

additionally, you can use yolov8 instant segment models, (Please see ultralytics models such as

• Open Image V7, which includes 600 pre-trained classes. (recommend)
• ImageNet, which includes 1000 pretrained classes. (also supported but need to add a class definition JSON map to show readable classes)

in this case, you have to download selected yolov8 models and copy it to to_your_sd_webui_dir/models/yolo/ and click the refresh button right of the model selection input to show newly added models.

[tanuki-create]

Thank you for your fast reply!

I tried it but not working...

I was able to add the model, but the output did not change at all. (I tried the low confidence as well)

Should I train the segmentation model of Yolo?

[wkpark]

0. Generate an image or drop image to the "Inpaint helper" found in the "u DDetailer" accordions.
1. do not choose object classes -> it will detect all detectable classes
2. checkbox "detect only"
3. inpainting test
4. based on these results, you can choose the object now.

basically, we don't know what "Tin can" is. but we can only select based on detected results.