search

omriav / blended-latent-diffusion

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
https://omriavrahami.com/blended-latent-diffusion-page/
MIT License
569 stars 34 forks source link

how to achieve the Scribble-guided editing #8

Closed Mr-Bright closed 1 year ago

Mr-Bright commented 1 year ago

I am very interested about the Scribble-guided editing which is posed in the paper, but I am confused how to use those code to evalutate it. Could you give me some instruction, pls?

omriav commented 1 year ago

Hi,

The scribble need to be done with an external image editing app. Then you provide a mask to the scribbles area and perform the standard image editing guided by the text prompt.

One important hyperparameter is the number of denoising steps, which controls the correspondence to the input scribble. For more details see Figure 32 in Blended Diffusion paper.