search

Zheng-Chong / CatVTON

CatVTON is a simple and efficient virtual try-on diffusion model with 1) Lightweight Network (899.06M parameters totally), 2) Parameter-Efficient Training (49.57M parameters trainable) and 3) Simplified Inference (< 8G VRAM for 1024X768 resolution).
Other
728 stars 85 forks source link

Problems when Face Printed on clothes #11

Closed mateng0716 closed 1 month ago

mateng0716 commented 1 month ago

微信截图_20240731172305

it seems to have some problems when the clothes is printed with a HEAD or FACE , it distorted easily~

Zheng-Chong commented 1 month ago

Thank you for raising the issue regarding face printing. The generation of faces has always been a challenge for SD, especially when the faces are relatively small. Perhaps adjusting the random seed could improve performance.

However, even though this is our goal, CatVTON, as a research-oriented project, cannot guarantee the desired outcomes in all situations. Your issue will provide support for our further improvement of the model, thank you😄！

mateng0716 commented 1 month ago

Thank you for raising the issue regarding face printing. The generation of faces has always been a challenge for SD, especially when the faces are relatively small. Perhaps adjusting the random seed could improve performance.

However, even though this is our goal, CatVTON, as a research-oriented project, cannot guarantee the desired outcomes in all situations. Your issue will provide support for our further improvement of the model, thank you😄！

I do not think it is the problem of face generation , I supposed that maybe the relative posotion of the human face and the printed face matters. maybe the model can not tell which is which?

Zheng-Chong commented 1 month ago

I tested some clothes with faces and there was no such serious distortion problem, maybe you could provide your test cases to help me see the problem further? image-2 image-3