search

adobe-research / custom-diffusion

Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)
https://www.cs.cmu.edu/~custom-diffusion
Other
1.87k stars 139 forks source link

Is it possible for the fine-tuned model to do inpainting job rather than image generation? #61

Closed asrlhhh closed 1 year ago

asrlhhh commented 1 year ago

Hi, I am wondering if I can use the model fine-tuned for new concept to do inpainting job?

hpstyl commented 1 year ago

Very interested in knowing this as well!

nupurkmr9 commented 1 year ago

Hi, I did try our method with Prompt-to-Prompt kind of techniques, e.g., replacing a dog in an image with a pet dog. I haven't tried inpainting extensively, but it should be possible. Can you mention any specific use case that you are thinking of? Thanks.

asrlhhh commented 1 year ago

Thanks for your response @nupurkmr9 what i wanted to do is more like product placement thing. Sometimes I just want to insert *s into an existing image in a harmonious way