search

lllyasviel / ControlNet

Let us control diffusion models!
Apache License 2.0
28.97k stars 2.62k forks source link

Abnormal image generation #586

Open wj7486 opened 7 months ago

wj7486 commented 7 months ago

Hello, I think Controlnet is a great job, but I encountered some issues while training it. image I trained ControlNet using a set of facial datasets, and during the training process, I found that the first generated image was abnormal. Therefore, I disabled ControlNet as a trainable network, as shown in the red box above. Unfortunately, using only the frozen SD described in the paper to generate images is also abnormal. Generate an image similar to the following image,But it should be a realistic facial image

image

The weight file is created using tool Add Control. py converted v1.5 version SD. May I ask how I should solve this problem？Looking forward to your reply

geroldmeisinger commented 7 months ago

try to generate an image of size 512x512

wj7486 commented 7 months ago

尝试生成大小为 512x512 的图像

Thank you very much for your reply. I also tried to generate 512x512 images, but still only using frozen SDv1.5, but the image generation still failed image