search

yisol / IDM-VTON

[ECCV2024] IDM-VTON : Improving Diffusion Models for Authentic Virtual Try-on in the Wild
https://idm-vton.github.io/
3.63k stars 577 forks source link

Fails for hats? #18

Open yosun opened 4 months ago

yosun commented 4 months ago

Hats get recognized as shirts?

https://replicate.com/p/xvz3g9h28xrgp0cf1fb9q7wqk0

yisol commented 4 months ago

Hello, demo model is a try-on model for upper garments. It will automatically mask the upper body of image. You can uncheck the checkbox [Use auto-generated mask] and manually mask your image with brush on demo page. But successful try-on is not guaranteed for hats since we did not use hat image data for training. Screenshot 2024-04-24 at 1 55 31 AM image (19)

ankitsiliconithub commented 4 months ago

any plan for bottom side clothes try on ?

yisol commented 4 months ago

@ankitsiliconithub We will update the demo page to support lower body garments and dresses in the future. But you can try it now with the inference script for dresscode. (--category="lower_body")

yosun commented 4 months ago

i think you should include hats training data