iPERDance / iPERCore

Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis
https://iperdance.github.io/work/impersonator-plus-plus.html
Apache License 2.0
2.42k stars 311 forks source link

colab result: Two legs are merged like wearing a dress :-) #38

Closed bigboss97 closed 3 years ago

bigboss97 commented 3 years ago

I'm experimenting on colab with different photos. This is my recent result: Screenshot - 20-12-29 15 26 44 You can see in the photos that the legs are spread out. But looks like it can't handle pants when they are too wide.

piaozhx commented 3 years ago

It seems that the cloth_smpl_link mode of digital_type failed in your case (which is used for the skirt case). you can close it by following steps:

  1. openassets/configs/deploy.toml
  2. change the value of digital_type to smpl (default value is cloth_smpl_link)
  3. delete all results and rerun the code
bigboss97 commented 3 years ago

Wow, problem fixed! Thank you so much. I downloaded deploy.toml, modified it and transfered it back. It would be great if there's an option in the colab.

bigboss97 commented 3 years ago

For some reason there's a black mark flashing around my left arm (right arm when I turn around) all the time: Screenshot - 20-12-29 22 36 33 I've tried the same reference video with other source images, with tight sleeves. The result was very clean.

piaozhx commented 3 years ago

The sleeves in your image are too wide compared to the body shape of the estimated SMPL model, so the deep network cannot be trained very well in the step of personalization, which causes the problem of "black mark".

bigboss97 commented 3 years ago

I fixed the problem by modifying the sleeves smaller, thanks. Another question, sometimes I got more "cloudy" edges than other even I was using the same input images: Screenshot - 20-12-31 14 00 50 Is there a parameter I can adjust?