search

eladrich / pixel2style2pixel

Official Implementation for "Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation" (CVPR 2021) presenting the pixel2style2pixel (pSp) framework
https://eladrich.github.io/pixel2style2pixel/
MIT License
3.18k stars 570 forks source link

Is it possible video2anime train？ like this project？ #310

Closed zhanghongyong123456 closed 1 year ago

zhanghongyong123456 commented 1 year ago

https://github.com/Sxela/ArcaneGAN（like this project） image Compared with this project（pix2pix-HD）, which one is more suitable for video conversion animation

Is there any project related to converting video to animation? I hope you can recommend it

yuval-alaluf commented 1 year ago

The problem with using StyleGAN out of the box for video generation is that it will not be temporally consistent. Therefore, if you want to work with something simple, I would recommend using something that is based on pix2pixHD. There are some StyleGAN-based works for video/animation generation but they require a lot of tricks to get temporally consistent results.

zhanghongyong123456 commented 1 year ago

pix2pixHD

OK. iTry it,can you give me a methods of producing data(a Pair of data),like this: image (It's a bit of a mismatch)

yuval-alaluf commented 1 year ago

Maybe something like AnimeGAN is something that you are looking for. For example: https://github.com/TachibanaYoshino/AnimeGANv3#art-face-to-usa-cartoon-style Other than that, I am not too familiar with stylization works.