search

Fantasy-Studio / Paint-by-Example

Paint by Example: Exemplar-based Image Editing with Diffusion Models
https://arxiv.org/abs/2211.13227
Other
1.03k stars 93 forks source link

Generate effect issues when mask size is different #33

Closed wzhiyuan2016 closed 1 year ago

wzhiyuan2016 commented 1 year ago

Hello, I conducted a small experiment: generating mud spots， The experimental results are as follows due to different mask sizes： 1. 1 2. 2 3. 3

Problem:

  1. When mask1 to mask2, no effect is generated
  2. When using mask3, it seems that it has not taken effect

What is the reason for this

thanks

wzhiyuan2016 commented 1 year ago

4 When I set the mask very low, it didn't take effect

Fantasy-Studio commented 1 year ago

The reason for the small mask not being able to generate good results is that the masks used during training are not so small. I believe this can be solved by adding this type of data during training. As for the results from mask1 to mask2, you can try a larger CFG guidance.

wzhiyuan2016 commented 1 year ago

The reason for the small mask not being able to generate good results is that the masks used during training are not so small. I believe this can be solved by adding this type of data during training. As for the results from mask1 to mask2, you can try a larger CFG guidance.

Okay, I'll give it a try，thanks