wenquanlu / HandRefiner

MIT License
701 stars 30 forks source link

The inpainting area has become blurred #18

Open YouTianlong opened 5 months ago

YouTianlong commented 5 months ago

Hi,I inpainting the hand area using webui, and after generating it, the hand area was clearly blurred, as if it had been rubbed with a rubber eraser. The depth map is correct. Thanks!

微信图片_20240112180543 微信图片_20240112180549

wenquanlu commented 5 months ago

Hi, can you show the masks and webui settings?

YouTianlong commented 5 months ago

Sorry, I didn't save the depth map last Friday. Today, I have regenerated it again.

951290495 input image

微信图片_20240115112927

微信图片_20240115112947

微信图片_20240115112952 webui settings

微信图片_20240115112956 depth mask

微信图片_20240115113001 output image

Thank you!

wenquanlu commented 5 months ago

Hi, as mentioned in the paper, because the hand controlnet is finetuned using synthetic data, you need to use control weight (control strength) less than 1 to achieve realistic texture, I recommend 0.4 - 0.8. You are using control weight of 1, which makes the high frequency details disappeared, thus looking blurred.

wenquanlu commented 5 months ago

Also, on other hand, you can also try using the original depth controlnet, although it may not as reliable in generating hand