open-mmlab / StyleShot

StyleShot: A SnapShot on Any Style. 一款可以迁移任意风格到任意内容的模型,无需针对图片微调,即能生成高质量的个性风格化图片!
https://styleshot.github.io/
MIT License
270 stars 16 forks source link

Confused about the motivation #32

Closed chenj02 closed 2 months ago

chenj02 commented 2 months ago

I‘m also trying to achieve style transfer task, but I’m comfused about myself and my motivation--the ControlNet has worked very well at style transfer, so why we still do this?

Jeoyal commented 2 months ago

Hi @chenj02 , thank you for your interest in our work. ControlNet adapts style transfer by shuffling image in pixel wise as style input. This simple design is difficult to extract rich and expressive style representations. In contrast, StyleShot utilizes a style-aware encoder specifically designed to extract style representations. Below, we provide the stylized results of ControlNet compared to StyleShot: img_v3_02er_ee3e356f-bb72-4e0f-ad02-10c4cc9a100g

chenj02 commented 2 months ago

thank you very much!!!