open-mmlab / StyleShot

StyleShot: A SnapShot on Any Style. 一款可以迁移任意风格到任意内容的模型,无需针对图片微调,即能生成高质量的个性风格化图片!
https://styleshot.github.io/
MIT License
229 stars 14 forks source link

Confused about the motivation #32

Closed chenj02 closed 2 weeks ago

chenj02 commented 2 weeks ago

I‘m also trying to achieve style transfer task, but I’m comfused about myself and my motivation--the ControlNet has worked very well at style transfer, so why we still do this?

Jeoyal commented 2 weeks ago

Hi @chenj02 , thank you for your interest in our work. ControlNet adapts style transfer by shuffling image in pixel wise as style input. This simple design is difficult to extract rich and expressive style representations. In contrast, StyleShot utilizes a style-aware encoder specifically designed to extract style representations. Below, we provide the stylized results of ControlNet compared to StyleShot: img_v3_02er_ee3e356f-bb72-4e0f-ad02-10c4cc9a100g

chenj02 commented 2 weeks ago

thank you very much!!!