CompVis / stable-diffusion

A latent text-to-image diffusion model
https://ommer-lab.com/research/latent-diffusion-models/
Other
68.02k stars 10.14k forks source link

How to add private content to the model v4 #174

Open inspire-boy opened 2 years ago

inspire-boy commented 2 years ago

How to add private content to the model, such as adding your own image, what are the brief steps

Forhek666 commented 2 years ago

python scripts/img2img.py --prompt "A fantasy landscape, trending on artstation" --init-img --strength 0.8

DasWookie commented 2 years ago

python scripts/img2img.py --prompt "A fantasy landscape, trending on artstation" --init-img --strength 0.8

He is asking about how to further train the v4 model checkpoint sd-v1-4.ckpt.

inspire-boy commented 2 years ago

@DasWookie @Forhek666 yes, thinks! in this way, img i provide become diffrent. it lose original image.

hopibel commented 2 years ago

Use low strength (around 0.3) for img2img to preserve the input image better

inspire-boy commented 2 years ago

Thank you very much. I will have a try.

DasWookie commented 2 years ago

Ahhh. Sorry, language barrier it appears. It seems that you AREN'T trying to add content for training to the model. So, you're just trying to preserve the look of an input image for img2img generation. In that case yeah, lower the strength value, or use masking to keep the area of the image you are trying to preserve.

inspire-boy commented 2 years ago

啊。抱歉,出现语言障碍。您似乎没有尝试向模型添加训练内容。因此,您只是想为 img2img 生成保留输入图像的外观。在这种情况下,是的,降低强度值,或使用遮罩来保留您尝试保留的图像区域。

Thank you. It's very interesting. It replaces PS to some extent

inspire-boy commented 2 years ago

Ahhh. Sorry, language barrier it appears. It seems that you AREN'T trying to add content for training to the model. So, you're just trying to preserve the look of an input image for img2img generation. In that case yeah, lower the strength value, or use masking to keep the area of the image you are trying to preserve.

I have another problem. How to use prompt to accurately find a TV character, such as Tom cat. I find that I can't generate Tom. Use: "Tom cat playing in garden" Or any other words