search

eladrich / pixel2style2pixel

Official Implementation for "Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation" (CVPR 2021) presenting the pixel2style2pixel (pSp) framework
https://eladrich.github.io/pixel2style2pixel/
MIT License
3.19k stars 570 forks source link

Alternative use of this project #88

Closed geekmangnu closed 3 years ago

geekmangnu commented 3 years ago

Hi, sorry for asking a naive question I am still learning GAN. Can this project used for garment virtual try-on? or pose transfer? Projects like vogue feeds the pose heatmaps to stylegan2 instead of feeding constant. I am trying to accomplish garment virtual try-on, have read lots of papers but confused where to start.Using stylegan is not common in this area only few started to using it (like VOGUE and Styleposegan) and seems to have good results. Can inversion also change clothes to a target clothe? I am just asking it not to direct myself wrong way. I know you are not working on specifically this narrow subject but probably you have a clear idea that if it can be used for it or not. If you have any recommendation on this area very appreciated. Thank you.

yuval-alaluf commented 3 years ago

Hi @geekmangnu , It's an interesting question. While I can't say for certain if pSp can be used for solving tasks such as garment try-on, it would definitely be interesting to try. However, the first step I would take is making sure that you are able to train a StyleGAN generator that is able to accurate generate high-quality images like those shown in the links you shared. Once you believe you have a high-quality GAN then you can start exploring various potential research directions such as those you mentioned.

geekmangnu commented 3 years ago

Thank you @yuval-alaluf for the feedback.