Can ipadapter handle transparent backgrounds?

tencent-ailab / IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

Apache License 2.0

4.82k stars 313 forks source link

Can ipadapter handle transparent backgrounds? #106

Open Charuru opened 10 months ago

Charuru commented 10 months ago

Question here: https://www.reddit.com/r/comfyui/comments/17ailay/ipadapter_working_with_alpha_or_how_to_use/

Trying to make the end result not have to deal with the black bg influencing the image.

https://i.imgur.com/GG3UO7w.png

xiaohu2015 commented 10 months ago

@Charuru now IP-Adapter don't support that (As far as I know, currently SD only supports RGB images). I think you can convert the bg to white bg instead of black bg?

Charuru commented 10 months ago

@xiaohu2015 Thanks, white background has a similar problem with the image being influenced. It sounds like it's unfixable right now?

xiaohu2015 commented 10 months ago

@Charuru yes, even for text prompt, the background is not completely controllable

cubiq commented 10 months ago

cut out the person after the generation and add the background with inpainting, mask or composition