Concerns

[haofanwang]

1. The overall structure is quite similar to InstantID (IPA+ControlNet) which is not fairly cited in the paper.
2. Why there is no visual comparison with InstantStyle (at least text-driven) even if it has been cited?
3. Although I run the demo using default params, the results (check following cases) are far from be perfect as shown in the paper, is there anything I have missed? Or the demo is not ready for testing?

[haofanwang]

FYI, I post example images used in above demos here.

For content,

For style,

[nowsyn]

Hi haofan @haofanwang, thanks for your instant feedback. The arxiv paper of StyleShot is a pre-print version. We will add the reference of InstantID and provide the comparison results from InstantStyle later.

For the 3-rd question, we update the demo with more user friendly UI. As we mentioned in the paper, we have done thesholding and dilation operation on HED (we name this new condition as Contour), which makes some details of the content image disappear. Contour mainly target for sparse content control as shown in the cases in our paper. To achieve fine-grained content control, we provide a version trained on Lineart. The results of the cases you provided are here, together with the results of the cases in our paper, and also more cases of high-level styles. We run these cases with the default settings under Advanced options with our StyleShot based on SD15.

The online demo will be updated tomorrow as the developers have already left for the day.

provided case

provided case

provided case

provided case

case in paper

case in paper

case in paper

case in paper

case in paper

more cases of sparse content control

more cases of sparse content control