search

SerialLain3170 / adeleine

Automatic line art colorization using various types of hint or without hint
Other
352 stars 47 forks source link

Developing systems which enable us to colorize diversely #7

Closed SerialLain3170 closed 2 years ago

SerialLain3170 commented 4 years ago

I have implemented architectures which generate colorization of single style. However, considering MUNIT, DRIT and so on, I'm wondering if I can develop systems which output diverse colorization. As far as I know, it seems that no papers about diverse colorization have existed. If anybody have ideas or know papers, please let me know.
I try to implement some methods which are related to disentanglement.

SerialLain3170 commented 4 years ago

I have tried diverse colorization without hint using BicycleGAN + Mode seeking regularizer in the directory.

However, I would like to develop diverse colorization with hints. In other words, I want to exploit the method for producing illustrations that have diverse drawing styles with the same color. I could not do this with using BicycleGAN, so I need to seek for another method.

int2char commented 3 years ago

well, the best way I know about for this task is using stylegan inversion (if you only want to colorize a constrained domain,like anime head), check this paper: Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation

SerialLain3170 commented 3 years ago

Thanks, I'll check it! Like thie paper, I have noticed many papers incoporating StyleGAN in I2I tranlation. StyleGAN has a great versatility...

meiguoofa commented 3 years ago

Hi Colorization Transformer can generate diverse colorization, maybe you can see it

SerialLain3170 commented 3 years ago

Thanks! I have found the idea of Colorization Transformer interesting.